Nov 29 14:39:46 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 14:39:46 user nova-compute[75215]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:39:46 user nova-compute[75215]: INFO nova.virt.driver [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 14:39:46 user nova-compute[75215]: INFO nova.compute.provider_config [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Acquiring lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Acquired lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Releasing lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Full set of CONF: {{(pid=75215) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ******************************************************************************** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Configuration options gathered from: {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ================================================================================ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] allow_resize_to_same_host      = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] arq_binding_timeout            = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] backdoor_port                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] backdoor_socket                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] block_device_allocate_retries  = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] block_device_allocate_retries_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cert                           = self.pem {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute_monitors               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] config_dir                     = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] config_drive_format            = iso9660 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] config_source                  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] console_host                   = user {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] control_exchange               = nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cpu_allocation_ratio           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] daemon                         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] debug                          = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_access_ip_network_name = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_availability_zone      = nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_ephemeral_format       = ext4 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_green_pool_size        = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] default_schedule_zone          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] disk_allocation_ratio          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] enable_new_services            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] enabled_ssl_apis               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] flat_injected                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] force_config_drive             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] force_raw_images               = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] graceful_shutdown_timeout      = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] heal_instance_info_cache_interval = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] host                           = user {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_build_timeout         = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_delete_interval       = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_name_template         = instance-%08x {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_usage_audit           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_usage_audit_period    = month {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] internal_service_availability_zone = internal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] key                            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] live_migration_retry_count     = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_config_append              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_dir                        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_file                       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_options                    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_rotate_interval            = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_rotate_interval_type       = days {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] log_rotation_type              = none {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] long_rpc_timeout               = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_concurrent_builds          = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_concurrent_live_migrations = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_concurrent_snapshots       = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_local_block_devices        = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_logfile_count              = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] max_logfile_size_mb            = 200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] maximum_instance_delete_attempts = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metadata_listen                = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metadata_listen_port           = 8775 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metadata_workers               = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] migrate_max_retries            = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] mkisofs_cmd                    = genisoimage {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] my_ip                          = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] network_allocate_retries       = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] osapi_compute_listen_port      = 8774 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] osapi_compute_unique_server_name_scope =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] osapi_compute_workers          = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] password_length                = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] periodic_enable                = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] periodic_fuzzy_delay           = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] pointer_model                  = ps2mouse {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] preallocate_images             = none {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] publish_errors                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] pybasedir                      = /opt/stack/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ram_allocation_ratio           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rate_limit_burst               = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rate_limit_except_level        = CRITICAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rate_limit_interval            = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reboot_timeout                 = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reclaim_instance_interval      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] record                         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reimage_timeout_per_gb         = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] report_interval                = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rescue_timeout                 = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reserved_host_cpus             = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reserved_host_disk_mb          = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reserved_host_memory_mb        = 512 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] reserved_huge_pages            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] resize_confirm_window          = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] resize_fs_using_block_device   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] resume_guests_state_on_host_boot = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rpc_response_timeout           = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] run_external_periodic_tasks    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] running_deleted_instance_action = reap {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] running_deleted_instance_timeout = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler_instance_sync_interval = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_down_time              = 720 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] servicegroup_driver            = db {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] shelved_offload_time           = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] shelved_poll_interval          = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] shutdown_timeout               = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] source_is_ipv6                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ssl_only                       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] state_path                     = /opt/stack/data/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] sync_power_state_interval      = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] sync_power_state_pool_size     = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] syslog_log_facility            = LOG_USER {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] tempdir                        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] timeout_nbd                    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] transport_url                  = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] update_resources_interval      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_cow_images                 = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_eventlog                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_journal                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_json                       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_rootwrap_daemon            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_stderr                     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] use_syslog                     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vcpu_pin_set                   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plugging_is_fatal          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plugging_timeout           = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] virt_mkfs                      = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] volume_usage_poll_interval     = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] watch_log_file                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] web                            = /usr/share/spice-html5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_concurrency.disable_process_locking = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.auth_strategy              = keystone {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.compute_link_prefix        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.dhcp_domain                = novalocal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.enable_instance_password   = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.glance_link_prefix         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.instance_list_per_project_cells = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.list_records_by_skipping_down_cells = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.local_metadata_per_cell    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.max_limit                  = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.metadata_cache_expiration  = 15 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.neutron_default_tenant_id  = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.use_forwarded_for          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.use_neutron_default_nets   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_dynamic_targets = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_jsonfile_path   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.backend_argument         = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.config_prefix            = cache.oslo {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.dead_timeout             = 60.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.debug_cache_backend      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.enable_retry_client      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.enable_socket_keepalive  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.enabled                  = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.expiration_time          = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.hashclient_retry_attempts = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_dead_retry      = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_password        =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_sasl_enabled    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.memcache_username        =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.proxies                  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.retry_attempts           = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.retry_delay              = 0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.socket_keepalive_count   = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.socket_keepalive_idle    = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.socket_keepalive_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.tls_allowed_ciphers      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.tls_cafile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.tls_certfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.tls_enabled              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cache.tls_keyfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.auth_section            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.auth_type               = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.cross_az_attach         = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.debug                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.endpoint_template       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.http_retries            = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.os_region_name          = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cinder.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.cpu_dedicated_set      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.cpu_shared_set         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.image_type_exclude_list = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.resource_provider_association_refresh = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.shutdown_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] conductor.workers              = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] console.allowed_origins        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] console.ssl_ciphers            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] console.ssl_minimum_version    = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] consoleauth.token_ttl          = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.service_type            = accelerator {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] cyborg.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.backend               = sqlalchemy {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.connection            = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.connection_debug      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.connection_parameters =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.connection_recycle_time = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.connection_trace      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.db_inc_retry_interval = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.db_max_retries        = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.db_max_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.db_retry_interval     = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.max_overflow          = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.max_pool_size         = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.max_retries           = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.mysql_wsrep_sync_wait = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.pool_timeout          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.retry_interval        = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.slave_connection      = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] database.sqlite_synchronous    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.backend           = sqlalchemy {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.connection        = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.connection_debug  = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.connection_parameters =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.connection_recycle_time = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.connection_trace  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.db_inc_retry_interval = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.db_max_retries    = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.db_max_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.db_retry_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.max_overflow      = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.max_pool_size     = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.max_retries       = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.pool_timeout      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.retry_interval    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.slave_connection  = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] api_database.sqlite_synchronous = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] devices.enabled_mdev_types     = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ephemeral_storage_encryption.enabled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.api_servers             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.debug                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.default_trusted_certificate_ids = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.enable_certificate_validation = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.enable_rbd_download     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.num_retries             = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.rbd_ceph_conf           =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.rbd_connect_timeout     = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.rbd_pool                =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.rbd_user                =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.service_type            = image {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.verify_glance_signatures = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] glance.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] guestfs.debug                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.config_drive_cdrom      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.config_drive_inject_password = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.enable_remotefx         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.instances_path_share    =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.limit_cpu_features      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.use_multipath_io        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.vswitch_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] mks.enabled                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.manager_interval   = 2400 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.precache_concurrency = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.remove_unused_base_images = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] image_cache.subdirectory_name  = _base {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.api_max_retries         = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.api_retry_interval      = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.auth_section            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.auth_type               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.conductor_group         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.peer_list               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.serial_console_state_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.service_type            = baremetal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ironic.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] key_manager.fixed_key          = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.barbican_api_version  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.barbican_endpoint     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.barbican_endpoint_type = public {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.barbican_region_name  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.cafile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.certfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.collect_timing        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.insecure              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.keyfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.number_of_retries     = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.retry_delay           = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.send_service_user_token = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.split_loggers         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.timeout               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.verify_ssl            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican.verify_ssl_path       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.auth_section = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.auth_type = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.cafile   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.certfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.collect_timing = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.insecure = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.keyfile  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.split_loggers = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] barbican_service_user.timeout  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.approle_role_id          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.approle_secret_id        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.cafile                   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.certfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.collect_timing           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.insecure                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.keyfile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.kv_mountpoint            = secret {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.kv_path                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.kv_version               = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.namespace                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.root_token_id            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.split_loggers            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.ssl_ca_crt_file          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.timeout                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.use_ssl                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.auth_section          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.auth_type             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.cafile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.certfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.collect_timing        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.connect_retries       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.connect_retry_delay   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.endpoint_override     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.insecure              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.keyfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.max_version           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.min_version           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.region_name           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.service_name          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.service_type          = identity {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.split_loggers         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.status_code_retries   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.timeout               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] keystone.version               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.connection_uri         =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_mode               = custom {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: WARNING oslo_config.cfg [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_power_governor_high = performance {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_power_management   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.device_detach_attempts = 8 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.device_detach_timeout  = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.disk_cachemodes        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.disk_prefix            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.enabled_perf_events    = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.file_backed_memory     = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.gid_maps               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.hw_disk_discard        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.hw_machine_type        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_rbd_pool        = rbd {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_type            = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.images_volume_group    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.inject_key             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.inject_partition       = -2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.inject_password        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.iscsi_iface            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.iser_use_multipath     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_downtime = 500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_inbound_addr = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_scheme  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_timeout_action = abort {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_tunnelled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: WARNING oslo_config.cfg [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 14:39:46 user nova-compute[75215]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 14:39:46 user nova-compute[75215]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 14:39:46 user nova-compute[75215]: and ``live_migration_inbound_addr`` respectively.
Nov 29 14:39:46 user nova-compute[75215]: ).  Its value may be silently ignored in the future.
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.live_migration_with_native_tls = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.max_queues             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.nfs_mount_options      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_pcie_ports         = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.pmem_namespaces        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.quobyte_client_cfg     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rbd_secret_uuid        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rbd_user               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rescue_image_id        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rescue_kernel_id       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.rx_queue_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.smbfs_mount_options    =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.snapshot_compression   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.snapshot_image_format  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.sparse_logical_volumes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.swtpm_enabled          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.swtpm_group            = tss {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.swtpm_user             = tss {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.sysinfo_serial         = unique {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.tb_cache_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.tx_queue_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.uid_maps               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.use_virtio_for_bridges = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.virt_type              = kvm {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.volume_clear           = zero {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.volume_clear_size      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.volume_use_multipath   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_cache_path   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.auth_section           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.auth_type              = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.cafile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.certfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.collect_timing         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.connect_retries        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.connect_retry_delay    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.default_floating_pool  = public {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.endpoint_override      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.extension_sync_interval = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.http_retries           = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.insecure               = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.keyfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.max_version            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.min_version            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.ovs_bridge             = br-int {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.physnets               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.region_name            = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.service_metadata_proxy = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.service_name           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.service_type           = network {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.split_loggers          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.status_code_retries    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.timeout                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] neutron.version                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] notifications.bdms_in_notifications = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] notifications.default_level    = INFO {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] notifications.notification_format = unversioned {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] notifications.notify_on_state_change = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] pci.alias                      = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] pci.device_spec                = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] pci.report_in_placement        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.auth_section         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.auth_type            = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.cafile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.certfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.collect_timing       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.connect_retries      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.connect_retry_delay  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.default_domain_id    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.default_domain_name  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.domain_id            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.domain_name          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.endpoint_override    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.insecure             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.keyfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.max_version          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.min_version          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.password             = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.project_domain_id    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.project_domain_name  = Default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.project_id           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.project_name         = service {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.region_name          = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.service_name         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.service_type         = placement {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.split_loggers        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.status_code_retries  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.system_scope         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.timeout              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.trust_id             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.user_domain_id       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.user_domain_name     = Default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.user_id              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.username             = placement {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] placement.version              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.cores                    = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.count_usage_from_placement = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.injected_file_content_bytes = 10240 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.injected_file_path_length = 255 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.injected_files           = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.instances                = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.key_pairs                = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.metadata_items           = 128 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.ram                      = 51200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.recheck_quota            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.server_group_members     = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] quota.server_groups            = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rdp.enabled                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.image_metadata_prefilter = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.max_attempts         = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.max_placement_results = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] scheduler.workers              = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.host_subset_size = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.isolated_hosts = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.isolated_images = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.pci_in_placement = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.track_instance_changes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metrics.required               = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metrics.weight_multiplier      = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] metrics.weight_setting         = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.enabled         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.port_range      = 10000:20000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] serial_console.serialproxy_port = 6083 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.auth_section      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.auth_type         = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.cafile            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.certfile          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.collect_timing    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.insecure          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.keyfile           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.send_service_user_token = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.split_loggers     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] service_user.timeout           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.agent_enabled            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.enabled                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.html5proxy_port          = 6082 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.image_compression        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.jpeg_compression         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.playback_compression     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.server_listen            = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.streaming_mode           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] spice.zlib_compression         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] upgrade_levels.baseapi         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] upgrade_levels.compute         = auto {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] upgrade_levels.conductor       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] upgrade_levels.scheduler       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.cafile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.certfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.insecure = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vendordata_dynamic_auth.timeout = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.api_retry_count         = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.ca_file                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.cache_prefix            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.cluster_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.connection_pool_size    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.console_delay_seconds   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.datastore_regex         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.host_ip                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.host_password           = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.host_port               = 443 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.host_username           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.integration_bridge      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.maximum_objects         = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.pbm_default_policy      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.pbm_enabled             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.pbm_wsdl_location       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.serial_port_proxy_uri   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.serial_port_service_uri = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.task_poll_interval      = 0.5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.use_linked_clone        = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.vnc_keymap              = en-us {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.vnc_port                = 5900 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vmware.vnc_port_total          = 10000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.auth_schemes               = ['none'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.enabled                    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.novncproxy_port            = 6080 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.vencrypt_ca_certs          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.vencrypt_client_cert       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vnc.vencrypt_client_key        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.disable_rootwrap   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.enable_numa_live_migration = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.libvirt_disable_apic = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.client_socket_timeout     = 900 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.default_pool_size         = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.keep_alive                = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.max_header_line           = 16384 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.ssl_ca_file               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.ssl_cert_file             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.ssl_key_file              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.tcp_keepidle              = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] zvm.ca_file                    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] zvm.cloud_connector_url        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] zvm.reachable_timeout          = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.enforce_new_defaults = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.enforce_scope      = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.policy_default_rule = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.connection_string     = messaging:// {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.enabled               = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.es_doc_type           = notification {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.es_scroll_size        = 10000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.es_scroll_time        = 2m {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.filter_error_trace    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.hmac_keys             = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.sentinel_service_name = mymaster {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.socket_timeout        = 0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.trace_requests        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler.trace_sqlalchemy      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler_jaeger.process_tags   = {} {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler_jaeger.service_name_prefix = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] profiler_otlp.service_name_prefix = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] remote_debug.host              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] remote_debug.port              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_notifications.retry = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.auth_section        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.auth_type           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.cafile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.certfile            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.collect_timing      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.connect_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.connect_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.endpoint_id         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.endpoint_override   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.insecure            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.keyfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.max_version         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.min_version         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.region_name         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.service_name        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.service_type        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.split_loggers       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.status_code_retries = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.timeout             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.valid_interfaces    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_limit.version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_reports.file_event_handler = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] oslo_reports.log_dir           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.group  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] vif_plug_ovs_privileged.user   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.isolate_vif         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] os_brick.lock_path             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.capabilities   = [21] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.group          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] privsep_osbrick.user           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.group           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.helper_command  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] nova_sys_admin.user            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 14:39:46 user nova-compute[75215]: DEBUG oslo_service.service [None req-c87ecac9-78eb-4a1e-ba8f-705f6abd8989 None None] ******************************************************************************** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 14:39:46 user nova-compute[75215]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Connecting to libvirt: qemu:///system {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4cc414a140> {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 14:39:47 user nova-compute[75215]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 14:39:47 user nova-compute[75215]: WARNING nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4cc414a140> {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Starting native event thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Starting green dispatch thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Starting connection event dispatch thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 14:39:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Connection event '1' reason 'None'
Nov 29 14:39:47 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 14:39:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.mount [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Initialising _HostMountState generation 0 {{(pid=75215) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 14:39:54 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host capabilities <capabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <host>
Nov 29 14:39:54 user nova-compute[75215]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 14:39:54 user nova-compute[75215]:     <cpu>
Nov 29 14:39:54 user nova-compute[75215]:       <arch>x86_64</arch>
Nov 29 14:39:54 user nova-compute[75215]:       <model>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <microcode version='1070'/>
Nov 29 14:39:54 user nova-compute[75215]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='osxsave'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='invtsc'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='rsba'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 14:39:54 user nova-compute[75215]:       <pages unit='KiB' size='4'/>
Nov 29 14:39:54 user nova-compute[75215]:       <pages unit='KiB' size='2048'/>
Nov 29 14:39:54 user nova-compute[75215]:     </cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <power_management>
Nov 29 14:39:54 user nova-compute[75215]:       <suspend_mem/>
Nov 29 14:39:54 user nova-compute[75215]:       <suspend_disk/>
Nov 29 14:39:54 user nova-compute[75215]:       <suspend_hybrid/>
Nov 29 14:39:54 user nova-compute[75215]:     </power_management>
Nov 29 14:39:54 user nova-compute[75215]:     <iommu support='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <migration_features>
Nov 29 14:39:54 user nova-compute[75215]:       <live/>
Nov 29 14:39:54 user nova-compute[75215]:       <uri_transports>
Nov 29 14:39:54 user nova-compute[75215]:         <uri_transport>tcp</uri_transport>
Nov 29 14:39:54 user nova-compute[75215]:         <uri_transport>rdma</uri_transport>
Nov 29 14:39:54 user nova-compute[75215]:       </uri_transports>
Nov 29 14:39:54 user nova-compute[75215]:     </migration_features>
Nov 29 14:39:54 user nova-compute[75215]:     <topology>
Nov 29 14:39:54 user nova-compute[75215]:       <cells num='2'>
Nov 29 14:39:54 user nova-compute[75215]:         <cell id='0'>
Nov 29 14:39:54 user nova-compute[75215]:           <memory unit='KiB'>8189224</memory>
Nov 29 14:39:54 user nova-compute[75215]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 29 14:39:54 user nova-compute[75215]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 14:39:54 user nova-compute[75215]:           <distances>
Nov 29 14:39:54 user nova-compute[75215]:             <sibling id='0' value='10'/>
Nov 29 14:39:54 user nova-compute[75215]:             <sibling id='1' value='20'/>
Nov 29 14:39:54 user nova-compute[75215]:           </distances>
Nov 29 14:39:54 user nova-compute[75215]:           <cpus num='6'>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 14:39:54 user nova-compute[75215]:           </cpus>
Nov 29 14:39:54 user nova-compute[75215]:         </cell>
Nov 29 14:39:54 user nova-compute[75215]:         <cell id='1'>
Nov 29 14:39:54 user nova-compute[75215]:           <memory unit='KiB'>8206460</memory>
Nov 29 14:39:54 user nova-compute[75215]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 29 14:39:54 user nova-compute[75215]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 14:39:54 user nova-compute[75215]:           <distances>
Nov 29 14:39:54 user nova-compute[75215]:             <sibling id='0' value='20'/>
Nov 29 14:39:54 user nova-compute[75215]:             <sibling id='1' value='10'/>
Nov 29 14:39:54 user nova-compute[75215]:           </distances>
Nov 29 14:39:54 user nova-compute[75215]:           <cpus num='6'>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 14:39:54 user nova-compute[75215]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 14:39:54 user nova-compute[75215]:           </cpus>
Nov 29 14:39:54 user nova-compute[75215]:         </cell>
Nov 29 14:39:54 user nova-compute[75215]:       </cells>
Nov 29 14:39:54 user nova-compute[75215]:     </topology>
Nov 29 14:39:54 user nova-compute[75215]:     <cache>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 14:39:54 user nova-compute[75215]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 14:39:54 user nova-compute[75215]:     </cache>
Nov 29 14:39:54 user nova-compute[75215]:     <secmodel>
Nov 29 14:39:54 user nova-compute[75215]:       <model>apparmor</model>
Nov 29 14:39:54 user nova-compute[75215]:       <doi>0</doi>
Nov 29 14:39:54 user nova-compute[75215]:     </secmodel>
Nov 29 14:39:54 user nova-compute[75215]:     <secmodel>
Nov 29 14:39:54 user nova-compute[75215]:       <model>dac</model>
Nov 29 14:39:54 user nova-compute[75215]:       <doi>0</doi>
Nov 29 14:39:54 user nova-compute[75215]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 14:39:54 user nova-compute[75215]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 14:39:54 user nova-compute[75215]:     </secmodel>
Nov 29 14:39:54 user nova-compute[75215]:   </host>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='alpha'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>clipper</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='armv6l'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='armv7l'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='aarch64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='cris'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='i686'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>isapc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>microvm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='kvm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <pae/>
Nov 29 14:39:54 user nova-compute[75215]:       <nonpae/>
Nov 29 14:39:54 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:       <apic default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='m68k'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>an5206</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>q800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='microblaze'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='microblazeel'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='mips'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='mipsel'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='mips64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>pica61</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>magnum</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='mips64el'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>pica61</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>magnum</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='16'>boston</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='ppc'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='ppc64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='ppc64le'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='riscv32'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='8'>spike</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='8'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='riscv64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='8'>spike</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='8'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='s390x'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='sh4'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>shix</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>r2d</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='sh4eb'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>shix</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>r2d</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='sparc'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>LX</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='sparc64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>niagara</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='x86_64'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='1'>isapc</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>microvm</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='kvm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:       <apic default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='xtensa'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>sim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>kc705</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ml605</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx200</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx60</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]:   <guest>
Nov 29 14:39:54 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 29 14:39:54 user nova-compute[75215]:     <arch name='xtensaeb'>
Nov 29 14:39:54 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 29 14:39:54 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='4'>sim</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>kc705</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ml605</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>virt</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx200</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>lx60</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 14:39:54 user nova-compute[75215]:       <domain type='qemu'/>
Nov 29 14:39:54 user nova-compute[75215]:     </arch>
Nov 29 14:39:54 user nova-compute[75215]:     <features>
Nov 29 14:39:54 user nova-compute[75215]:       <cpuselection/>
Nov 29 14:39:54 user nova-compute[75215]:       <deviceboot/>
Nov 29 14:39:54 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     </features>
Nov 29 14:39:54 user nova-compute[75215]:   </guest>
Nov 29 14:39:54 user nova-compute[75215]: </capabilities>
Nov 29 14:39:54 user nova-compute[75215]: 
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-i440fx-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>i686</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='255'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'/>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ide</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-q35-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>i686</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='288'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'/>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-i440fx-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>i686</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='255'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'/>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ide</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-q35-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>i686</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='288'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'/>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-i440fx-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='255'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>efi</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ide</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-q35-6.2</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='288'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>efi</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-i440fx-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='255'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>efi</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ide</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 14:39:54 user nova-compute[75215]: <domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 14:39:54 user nova-compute[75215]:   <domain>kvm</domain>
Nov 29 14:39:54 user nova-compute[75215]:   <machine>pc-q35-jammy</machine>
Nov 29 14:39:54 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 29 14:39:54 user nova-compute[75215]:   <vcpu max='288'/>
Nov 29 14:39:54 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:   <os supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='firmware'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>efi</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:     <loader supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>rom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pflash</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='readonly'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='secure'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>yes</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>no</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </loader>
Nov 29 14:39:54 user nova-compute[75215]:   </os>
Nov 29 14:39:54 user nova-compute[75215]:   <cpu>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>on</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>off</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 29 14:39:54 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 29 14:39:54 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 29 14:39:54 user nova-compute[75215]:     </mode>
Nov 29 14:39:54 user nova-compute[75215]:   </cpu>
Nov 29 14:39:54 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:     <enum name='sourceType'>
Nov 29 14:39:54 user nova-compute[75215]:       <value>file</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>anonymous</value>
Nov 29 14:39:54 user nova-compute[75215]:       <value>memfd</value>
Nov 29 14:39:54 user nova-compute[75215]:     </enum>
Nov 29 14:39:54 user nova-compute[75215]:   </memoryBacking>
Nov 29 14:39:54 user nova-compute[75215]:   <devices>
Nov 29 14:39:54 user nova-compute[75215]:     <disk supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>disk</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cdrom</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>floppy</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>lun</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='bus'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>fdc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sata</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </disk>
Nov 29 14:39:54 user nova-compute[75215]:     <graphics supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='type'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>sdl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vnc</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>spice</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egl-headless</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </graphics>
Nov 29 14:39:54 user nova-compute[75215]:     <video supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='modelType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>cirrus</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>vmvga</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>qxl</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>none</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>bochs</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>ramfb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </video>
Nov 29 14:39:54 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='mode'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>subsystem</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>default</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>mandatory</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>requisite</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>optional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='subsysType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>usb</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>pci</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>scsi</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='capsType'/>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 29 14:39:54 user nova-compute[75215]:     </hostdev>
Nov 29 14:39:54 user nova-compute[75215]:     <rng supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>random</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>egd</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>builtin</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </rng>
Nov 29 14:39:54 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='driverType'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>path</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>handle</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>virtiofs</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </filesystem>
Nov 29 14:39:54 user nova-compute[75215]:     <tpm supported='yes'>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='model'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:       <enum name='backendModel'>
Nov 29 14:39:54 user nova-compute[75215]:         <value>passthrough</value>
Nov 29 14:39:54 user nova-compute[75215]:         <value>emulator</value>
Nov 29 14:39:54 user nova-compute[75215]:       </enum>
Nov 29 14:39:54 user nova-compute[75215]:     </tpm>
Nov 29 14:39:54 user nova-compute[75215]:   </devices>
Nov 29 14:39:54 user nova-compute[75215]:   <features>
Nov 29 14:39:54 user nova-compute[75215]:     <gic supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <genid supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <backup supported='yes'/>
Nov 29 14:39:54 user nova-compute[75215]:     <sev supported='no'/>
Nov 29 14:39:54 user nova-compute[75215]:   </features>
Nov 29 14:39:54 user nova-compute[75215]: </domainCapabilities>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 14:39:54 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Secure Boot support detected
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] cpu compare xml: <cpu match="exact">
Nov 29 14:39:54 user nova-compute[75215]:   <model>Nehalem</model>
Nov 29 14:39:54 user nova-compute[75215]: </cpu>
Nov 29 14:39:54 user nova-compute[75215]:  {{(pid=75215) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 14:39:54 user nova-compute[75215]: INFO nova.virt.node [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Generated node identity 2212761d-64cd-4bb5-94ac-48b883e4044b
Nov 29 14:39:54 user nova-compute[75215]: INFO nova.virt.node [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Wrote node identity 2212761d-64cd-4bb5-94ac-48b883e4044b to /opt/stack/data/nova/compute_id
Nov 29 14:39:54 user nova-compute[75215]: WARNING nova.compute.manager [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Compute nodes ['2212761d-64cd-4bb5-94ac-48b883e4044b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 14:39:54 user nova-compute[75215]: INFO nova.compute.manager [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 14:39:54 user nova-compute[75215]: WARNING nova.compute.manager [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 14:39:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:39:54 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:39:54 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:39:54 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Hypervisor/Node resource view: name=user free_ram=11038MB free_disk=25.92281723022461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:39:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:39:55 user nova-compute[75215]: WARNING nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] No compute node record for user:2212761d-64cd-4bb5-94ac-48b883e4044b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2212761d-64cd-4bb5-94ac-48b883e4044b could not be found.
Nov 29 14:39:55 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Compute node record created for user:user with uuid: 2212761d-64cd-4bb5-94ac-48b883e4044b
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:39:55 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] [req-0d9fe00f-0fbf-4c03-96a8-0fb35af15b86] Created resource provider record via placement API for resource provider with UUID 2212761d-64cd-4bb5-94ac-48b883e4044b and name user.
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75215) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 14:39:55 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] kernel doesn't support AMD SEV
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Libvirt baseline CPU <cpu>
Nov 29 14:39:55 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 29 14:39:55 user nova-compute[75215]:   <model>Nehalem</model>
Nov 29 14:39:55 user nova-compute[75215]:   <vendor>Intel</vendor>
Nov 29 14:39:55 user nova-compute[75215]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 14:39:55 user nova-compute[75215]: </cpu>
Nov 29 14:39:55 user nova-compute[75215]:  {{(pid=75215) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Updated inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Updating resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b generation from 0 to 1 during operation: update_inventory {{(pid=75215) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Updating resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b generation from 1 to 2 during operation: update_traits {{(pid=75215) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.service [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Creating RPC server for service compute {{(pid=75215) start /opt/stack/nova/nova/service.py:182}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.service [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] Join ServiceGroup membership for this service compute {{(pid=75215) start /opt/stack/nova/nova/service.py:199}}
Nov 29 14:39:55 user nova-compute[75215]: DEBUG nova.servicegroup.drivers.db [None req-4a5ea236-6ffb-476b-8ca7-7973024208d0 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75215) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 14:40:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:40:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:40:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=10461MB free_disk=25.826622009277344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:41:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:41:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:41:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:41:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=10432MB free_disk=25.89162826538086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:41:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:42:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:42:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:42:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=10412MB free_disk=25.645668029785156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:42:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:42:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:43:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:43:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:43:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9729MB free_disk=25.672996520996094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:43:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:43:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:43:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:43:50 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:43:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:43:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:43:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:43:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:43:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:43:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:06 user nova-compute[75215]: INFO nova.compute.claims [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Claim successful on node user
Nov 29 14:44:06 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Creating image(s)
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "/opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "/opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "/opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:07 user nova-compute[75215]: DEBUG nova.policy [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12e3247c3c5043b49c90ec217ba32047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f783ac7db93e4842b2faea3f44cedf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG nova.virt.images [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] e99e1aa5-1b15-43b4-b195-011929ff5a30 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.part /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.part /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.converted" returned: 0 in 0.357s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:08 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7mrg9qiq/privsep.sock']
Nov 29 14:44:08 user sudo[84478]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7mrg9qiq/privsep.sock
Nov 29 14:44:08 user sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 14:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:09 user nova-compute[75215]: INFO nova.compute.claims [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Claim successful on node user
Nov 29 14:44:10 user sudo[84478]: pam_unix(sudo:session): session closed for user root
Nov 29 14:44:10 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Spawned new privsep daemon via rootwrap
Nov 29 14:44:10 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 14:44:10 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 14:44:10 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 14:44:10 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84494
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk 1073741824" returned: 0 in 0.048s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.policy [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f3cbb55df1494f94e304bfc82c4c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce0446252d5486794553a9cae9281af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Creating image(s)
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Successfully created port: 9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Cannot resize image /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Ensure instance console log exists: /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk 1073741824" returned: 0 in 0.039s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Cannot resize image /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Ensure instance console log exists: /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:13 user nova-compute[75215]: INFO nova.compute.claims [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Claim successful on node user
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Successfully created port: 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Successfully updated port: 9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquired lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Creating image(s)
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.policy [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a063f501a31542d697e9d55b0cfae654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbf5053f1114a2aa4ed9a5ed0d51614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-changed-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Refreshing instance network info cache due to event network-changed-9d752033-0ad5-44c1-adbb-0eb63b650ee9. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] Acquiring lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk 1073741824" returned: 0 in 0.046s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Cannot resize image /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Ensure instance console log exists: /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updating instance_info_cache with network_info: [{"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Releasing lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Instance network_info: |[{"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] Acquired lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Refreshing network info cache for port 9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Start _get_guest_xml network_info=[{"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1222554813',display_name='tempest-DeleteServersTestJSON-server-1222554813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1222554813',id=1,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f783ac7db93e4842b2faea3f44cedf40',ramdisk_id='',reservation_id='r-75kbfkr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1685238907',owner_user_name='tempest-DeleteServersTestJSON-1685238907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:07Z,user_data=None,user_id='12e3247c3c5043b49c90ec217ba32047',uuid=d65d7f5b-65c1-46c7-be85-b72b266910ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converting VIF {"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lazy-loading 'pci_devices' on Instance uuid d65d7f5b-65c1-46c7-be85-b72b266910ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:15 user nova-compute[75215]:   <uuid>d65d7f5b-65c1-46c7-be85-b72b266910ca</uuid>
Nov 29 14:44:15 user nova-compute[75215]:   <name>instance-00000001</name>
Nov 29 14:44:15 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:15 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:15 user nova-compute[75215]:   <metadata>
Nov 29 14:44:15 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:15 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:name>tempest-DeleteServersTestJSON-server-1222554813</nova:name>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:15</nova:creationTime>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:15 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:15 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:user uuid="12e3247c3c5043b49c90ec217ba32047">tempest-DeleteServersTestJSON-1685238907-project-member</nova:user>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:project uuid="f783ac7db93e4842b2faea3f44cedf40">tempest-DeleteServersTestJSON-1685238907</nova:project>
Nov 29 14:44:15 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:15 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:15 user nova-compute[75215]:         <nova:port uuid="9d752033-0ad5-44c1-adbb-0eb63b650ee9">
Nov 29 14:44:15 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 14:44:15 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:15 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:15 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:15 user nova-compute[75215]:   </metadata>
Nov 29 14:44:15 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:15 user nova-compute[75215]:     <system>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="serial">d65d7f5b-65c1-46c7-be85-b72b266910ca</entry>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="uuid">d65d7f5b-65c1-46c7-be85-b72b266910ca</entry>
Nov 29 14:44:15 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:15 user nova-compute[75215]:     </system>
Nov 29 14:44:15 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:15 user nova-compute[75215]:   <os>
Nov 29 14:44:15 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:15 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:15 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:15 user nova-compute[75215]:   </os>
Nov 29 14:44:15 user nova-compute[75215]:   <features>
Nov 29 14:44:15 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:15 user nova-compute[75215]:     <apic/>
Nov 29 14:44:15 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:15 user nova-compute[75215]:   </features>
Nov 29 14:44:15 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:15 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:15 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:15 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:15 user nova-compute[75215]:   </clock>
Nov 29 14:44:15 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:15 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:15 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:15 user nova-compute[75215]:   </cpu>
Nov 29 14:44:15 user nova-compute[75215]:   <devices>
Nov 29 14:44:15 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:15 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:15 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk"/>
Nov 29 14:44:15 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:15 user nova-compute[75215]:     </disk>
Nov 29 14:44:15 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:15 user nova-compute[75215]:       <mac address="fa:16:3e:98:f7:47"/>
Nov 29 14:44:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:15 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:15 user nova-compute[75215]:       <target dev="tap9d752033-0a"/>
Nov 29 14:44:15 user nova-compute[75215]:     </interface>
Nov 29 14:44:15 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:15 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/console.log" append="off"/>
Nov 29 14:44:15 user nova-compute[75215]:     </serial>
Nov 29 14:44:15 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:15 user nova-compute[75215]:     <video>
Nov 29 14:44:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:15 user nova-compute[75215]:     </video>
Nov 29 14:44:15 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:15 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:15 user nova-compute[75215]:     </rng>
Nov 29 14:44:15 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:15 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:15 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:15 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:15 user nova-compute[75215]:   </devices>
Nov 29 14:44:15 user nova-compute[75215]: </domain>
Nov 29 14:44:15 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1222554813',display_name='tempest-DeleteServersTestJSON-server-1222554813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1222554813',id=1,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f783ac7db93e4842b2faea3f44cedf40',ramdisk_id='',reservation_id='r-75kbfkr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1685238907',owner_user_name='tempest-DeleteServersTestJSON-1685238907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:07Z,user_data=None,user_id='12e3247c3c5043b49c90ec217ba32047',uuid=d65d7f5b-65c1-46c7-be85-b72b266910ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converting VIF {"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG os_vif [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Created schema index Interface.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Created schema index Port.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Created schema index Bridge.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [POLLOUT] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d31d247-8ad5-5963-925c-914a5556b94d', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:15 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpf9h4_v1p/privsep.sock']
Nov 29 14:44:15 user sudo[84569]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpf9h4_v1p/privsep.sock
Nov 29 14:44:15 user sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 14:44:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Successfully updated port: 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing instance network info cache due to event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updated VIF entry in instance network info cache for port 9d752033-0ad5-44c1-adbb-0eb63b650ee9. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updating instance_info_cache with network_info: [{"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:17 user sudo[84569]: pam_unix(sudo:session): session closed for user root
Nov 29 14:44:17 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Spawned new privsep daemon via rootwrap
Nov 29 14:44:17 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 14:44:17 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 14:44:17 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 14:44:17 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84576
Nov 29 14:44:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-558b1546-06ef-45f4-a834-b9b396419b7b req-5846cc8d-297b-453a-b1ab-2563ab5f7349 service nova] Releasing lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Successfully created port: 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance network_info: |[{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start _get_guest_xml network_info=[{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwGaC1Nm9K34x9cPtaxop9xRNSgbiSQga98YJy4h636DPnKHt1Ja6uM+uXVIHV7NLv6Xoqq3YEC/jfus7jhkEve70FWsW27cfmacVN1w96sco8bHSttiv3DoNI3qLVNiQ==',key_name='tempest-keypair-786004936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_devices' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:17 user nova-compute[75215]:   <uuid>ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</uuid>
Nov 29 14:44:17 user nova-compute[75215]:   <name>instance-00000002</name>
Nov 29 14:44:17 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:17 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:17 user nova-compute[75215]:   <metadata>
Nov 29 14:44:17 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:17 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-720794654</nova:name>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:17</nova:creationTime>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:17 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:17 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:user uuid="21f3cbb55df1494f94e304bfc82c4c5c">tempest-AttachVolumeShelveTestJSON-1453470125-project-member</nova:user>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:project uuid="bce0446252d5486794553a9cae9281af">tempest-AttachVolumeShelveTestJSON-1453470125</nova:project>
Nov 29 14:44:17 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:17 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:17 user nova-compute[75215]:         <nova:port uuid="115a6cca-db08-49e7-9978-7b78f2fbf532">
Nov 29 14:44:17 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 14:44:17 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:17 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:17 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:17 user nova-compute[75215]:   </metadata>
Nov 29 14:44:17 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:17 user nova-compute[75215]:     <system>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="serial">ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</entry>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="uuid">ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</entry>
Nov 29 14:44:17 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:17 user nova-compute[75215]:     </system>
Nov 29 14:44:17 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:17 user nova-compute[75215]:   <os>
Nov 29 14:44:17 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:17 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:17 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:17 user nova-compute[75215]:   </os>
Nov 29 14:44:17 user nova-compute[75215]:   <features>
Nov 29 14:44:17 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:17 user nova-compute[75215]:     <apic/>
Nov 29 14:44:17 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:17 user nova-compute[75215]:   </features>
Nov 29 14:44:17 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:17 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:17 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:17 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:17 user nova-compute[75215]:   </clock>
Nov 29 14:44:17 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:17 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:17 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:17 user nova-compute[75215]:   </cpu>
Nov 29 14:44:17 user nova-compute[75215]:   <devices>
Nov 29 14:44:17 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:17 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:17 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk"/>
Nov 29 14:44:17 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:17 user nova-compute[75215]:     </disk>
Nov 29 14:44:17 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:17 user nova-compute[75215]:       <mac address="fa:16:3e:3e:8a:97"/>
Nov 29 14:44:17 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:17 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:17 user nova-compute[75215]:       <target dev="tap115a6cca-db"/>
Nov 29 14:44:17 user nova-compute[75215]:     </interface>
Nov 29 14:44:17 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:17 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/console.log" append="off"/>
Nov 29 14:44:17 user nova-compute[75215]:     </serial>
Nov 29 14:44:17 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:17 user nova-compute[75215]:     <video>
Nov 29 14:44:17 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:17 user nova-compute[75215]:     </video>
Nov 29 14:44:17 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:17 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:17 user nova-compute[75215]:     </rng>
Nov 29 14:44:17 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:17 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:17 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:17 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:17 user nova-compute[75215]:   </devices>
Nov 29 14:44:17 user nova-compute[75215]: </domain>
Nov 29 14:44:17 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwGaC1Nm9K34x9cPtaxop9xRNSgbiSQga98YJy4h636DPnKHt1Ja6uM+uXVIHV7NLv6Xoqq3YEC/jfus7jhkEve70FWsW27cfmacVN1w96sco8bHSttiv3DoNI3qLVNiQ==',key_name='tempest-keypair-786004936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG os_vif [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '633ac06f-77c1-51c6-870c-5c508271bb8a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d752033-0a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d752033-0a, col_values=(('qos', UUID('c7b1566e-8439-47f5-9781-cd8429546782')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d752033-0a, col_values=(('external_ids', {'iface-id': '9d752033-0ad5-44c1-adbb-0eb63b650ee9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:f7:47', 'vm-uuid': 'd65d7f5b-65c1-46c7-be85-b72b266910ca'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: INFO os_vif [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a')
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap115a6cca-db, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap115a6cca-db, col_values=(('qos', UUID('74c47a8f-2b10-41e8-be0a-963804f2e843')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap115a6cca-db, col_values=(('external_ids', {'iface-id': '115a6cca-db08-49e7-9978-7b78f2fbf532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:8a:97', 'vm-uuid': 'ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:17 user nova-compute[75215]: INFO os_vif [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db')
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] No VIF found with MAC fa:16:3e:98:f7:47, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No VIF found with MAC fa:16:3e:3e:8a:97, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updated VIF entry in instance network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1829337-45e2-47c3-b54b-3443da9930be req-126f5e0e-baa3-488c-a488-ec4532a31a43 service nova] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Successfully updated port: 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-changed-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing instance network info cache due to event network-changed-53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance network_info: |[{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing network info cache for port 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start _get_guest_xml network_info=[{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-9420683',display_name='tempest-ServerStableDeviceRescueTest-server-9420683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-9420683',id=3,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8l9zcAEfUJXLwxmzSZOyd4p4+vXl/nKxXU8V2PI2b/26W84tahbT/rs54F6AwquAB8jS4d6Y7URrR2u/52PAQ7tNAFyIGq0BuJQ6i2FCjlQKPS/1rNird42qquTp52ww==',key_name='tempest-keypair-468001882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbf5053f1114a2aa4ed9a5ed0d51614',ramdisk_id='',reservation_id='r-f63jdpqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-551332558',owner_user_name='tempest-ServerStableDeviceRescueTest-551332558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a063f501a31542d697e9d55b0cfae654',uuid=fae0e81c-9fcc-4a56-a9eb-876c830820b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converting VIF {"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:20 user nova-compute[75215]: DEBUG nova.objects.instance [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'pci_devices' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:21 user nova-compute[75215]:   <uuid>fae0e81c-9fcc-4a56-a9eb-876c830820b2</uuid>
Nov 29 14:44:21 user nova-compute[75215]:   <name>instance-00000003</name>
Nov 29 14:44:21 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:21 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:21 user nova-compute[75215]:   <metadata>
Nov 29 14:44:21 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:21 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-9420683</nova:name>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:20</nova:creationTime>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:21 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:21 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:user uuid="a063f501a31542d697e9d55b0cfae654">tempest-ServerStableDeviceRescueTest-551332558-project-member</nova:user>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:project uuid="6bbf5053f1114a2aa4ed9a5ed0d51614">tempest-ServerStableDeviceRescueTest-551332558</nova:project>
Nov 29 14:44:21 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:21 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:21 user nova-compute[75215]:         <nova:port uuid="53921259-ca48-418b-959d-c373a73a6807">
Nov 29 14:44:21 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:44:21 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:21 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:21 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:21 user nova-compute[75215]:   </metadata>
Nov 29 14:44:21 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:21 user nova-compute[75215]:     <system>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="serial">fae0e81c-9fcc-4a56-a9eb-876c830820b2</entry>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="uuid">fae0e81c-9fcc-4a56-a9eb-876c830820b2</entry>
Nov 29 14:44:21 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:21 user nova-compute[75215]:     </system>
Nov 29 14:44:21 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:21 user nova-compute[75215]:   <os>
Nov 29 14:44:21 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:21 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:21 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:21 user nova-compute[75215]:   </os>
Nov 29 14:44:21 user nova-compute[75215]:   <features>
Nov 29 14:44:21 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:21 user nova-compute[75215]:     <apic/>
Nov 29 14:44:21 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:21 user nova-compute[75215]:   </features>
Nov 29 14:44:21 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:21 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:21 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:21 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:21 user nova-compute[75215]:   </clock>
Nov 29 14:44:21 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:21 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:21 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:21 user nova-compute[75215]:   </cpu>
Nov 29 14:44:21 user nova-compute[75215]:   <devices>
Nov 29 14:44:21 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:21 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:21 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk"/>
Nov 29 14:44:21 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:21 user nova-compute[75215]:     </disk>
Nov 29 14:44:21 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:21 user nova-compute[75215]:       <mac address="fa:16:3e:23:8d:64"/>
Nov 29 14:44:21 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:21 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:21 user nova-compute[75215]:       <target dev="tap53921259-ca"/>
Nov 29 14:44:21 user nova-compute[75215]:     </interface>
Nov 29 14:44:21 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:21 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/console.log" append="off"/>
Nov 29 14:44:21 user nova-compute[75215]:     </serial>
Nov 29 14:44:21 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:21 user nova-compute[75215]:     <video>
Nov 29 14:44:21 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:21 user nova-compute[75215]:     </video>
Nov 29 14:44:21 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:21 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:21 user nova-compute[75215]:     </rng>
Nov 29 14:44:21 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:21 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:21 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:21 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:21 user nova-compute[75215]:   </devices>
Nov 29 14:44:21 user nova-compute[75215]: </domain>
Nov 29 14:44:21 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-9420683',display_name='tempest-ServerStableDeviceRescueTest-server-9420683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-9420683',id=3,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8l9zcAEfUJXLwxmzSZOyd4p4+vXl/nKxXU8V2PI2b/26W84tahbT/rs54F6AwquAB8jS4d6Y7URrR2u/52PAQ7tNAFyIGq0BuJQ6i2FCjlQKPS/1rNird42qquTp52ww==',key_name='tempest-keypair-468001882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbf5053f1114a2aa4ed9a5ed0d51614',ramdisk_id='',reservation_id='r-f63jdpqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-551332558',owner_user_name='tempest-ServerStableDeviceRescueTest-551332558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a063f501a31542d697e9d55b0cfae654',uuid=fae0e81c-9fcc-4a56-a9eb-876c830820b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converting VIF {"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG os_vif [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '051b2751-6ed8-5838-93b5-487f296afc61', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53921259-ca, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53921259-ca, col_values=(('qos', UUID('cdb59345-781e-4307-ad3f-cf84fe6a624c')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53921259-ca, col_values=(('external_ids', {'iface-id': '53921259-ca48-418b-959d-c373a73a6807', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:8d:64', 'vm-uuid': 'fae0e81c-9fcc-4a56-a9eb-876c830820b2'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: INFO os_vif [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca')
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No VIF found with MAC fa:16:3e:23:8d:64, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance spawned successfully.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Instance spawned successfully.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Took 15.09 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Took 11.64 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.compute.manager [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Took 16.16 seconds to build instance.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ab1429f2-552d-42d8-bc63-0e67dd3c7f36 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.393s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:22 user nova-compute[75215]: INFO nova.compute.manager [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Took 13.06 seconds to build instance.
Nov 29 14:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7a2a468e-8b7d-4478-8055-761ebde9ff96 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.226s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updated VIF entry in instance network info cache for port 53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19229624-bce2-48da-b86d-2c9ea603d484 req-4870d7cf-1081-453a-8cab-bd97a4f55a59 service nova] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:24 user nova-compute[75215]: INFO nova.compute.claims [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Claim successful on node user
Nov 29 14:44:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG nova.policy [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '787e570bb87c4528a6e117e3b390e7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cee1d9633347bbb6ada4841f2bbb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Creating image(s)
Nov 29 14:44:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "827312a0ea9750696828ef4dc856fb8d9282ba24" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "827312a0ea9750696828ef4dc856fb8d9282ba24" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance spawned successfully.
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.virt.images [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] 1c1f5b82-9297-44c0-82c9-08c454893445 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.part /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:26 user nova-compute[75215]: INFO nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Took 12.22 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:26 user nova-compute[75215]: INFO nova.compute.manager [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Took 13.04 seconds to build instance.
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-66777989-ff1a-48f9-a8b8-4f3841ae4030 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.217s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.part /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.converted" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24.converted --force-share --output=json" returned: 0 in 0.282s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "827312a0ea9750696828ef4dc856fb8d9282ba24" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.581s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json" returned: 0 in 0.241s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "827312a0ea9750696828ef4dc856fb8d9282ba24" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "827312a0ea9750696828ef4dc856fb8d9282ba24" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json" returned: 0 in 0.323s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24,backing_fmt=raw /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24,backing_fmt=raw /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk 1073741824" returned: 0 in 0.069s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "827312a0ea9750696828ef4dc856fb8d9282ba24" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 --force-share --output=json" returned: 0 in 0.239s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Cannot resize image /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Ensure instance console log exists: /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Successfully created port: 7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Successfully updated port: 7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquired lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-changed-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Refreshing instance network info cache due to event network-changed-7ac9dc69-7478-419e-b800-96c16c9a67bc. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] Acquiring lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updating instance_info_cache with network_info: [{"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Releasing lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Instance network_info: |[{"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] Acquired lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Refreshing network info cache for port 7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Start _get_guest_xml network_info=[{"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=1c1f5b82-9297-44c0-82c9-08c454893445,min_disk=0,min_ram=0,name='',owner='b96f54da4609498d86325e6a20188036',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/sda', 'encryption_format': None, 'size': 0, 'image_id': '1c1f5b82-9297-44c0-82c9-08c454893445'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=1c1f5b82-9297-44c0-82c9-08c454893445,min_disk=0,min_ram=0,name='',owner='b96f54da4609498d86325e6a20188036',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1920352381',display_name='tempest-AttachSCSIVolumeTestJSON-server-1920352381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1920352381',id=4,image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+N9u0XyDqUOQjMmX/L6lW7nl5BGkpfVmHCirwidW8H+hrcFefVWd8Xjc/NmixvFZhOcZXoN56APkvJiE1148owDCYra0iqnsgSxwGz8TsAT6TtPDIxw/RwXiNo9iLB9w==',key_name='tempest-keypair-1961959538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5cee1d9633347bbb6ada4841f2bbb78',ramdisk_id='',reservation_id='r-o4ac2gd1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-451587206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-451587206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='787e570bb87c4528a6e117e3b390e7bb',uuid=bebb8ca0-07ba-4d7d-b446-33faf800b6ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converting VIF {"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lazy-loading 'pci_devices' on Instance uuid bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:31 user nova-compute[75215]:   <uuid>bebb8ca0-07ba-4d7d-b446-33faf800b6ff</uuid>
Nov 29 14:44:31 user nova-compute[75215]:   <name>instance-00000004</name>
Nov 29 14:44:31 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:31 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:31 user nova-compute[75215]:   <metadata>
Nov 29 14:44:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:31 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1920352381</nova:name>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:30</nova:creationTime>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:31 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:31 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:user uuid="787e570bb87c4528a6e117e3b390e7bb">tempest-AttachSCSIVolumeTestJSON-451587206-project-member</nova:user>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:project uuid="b5cee1d9633347bbb6ada4841f2bbb78">tempest-AttachSCSIVolumeTestJSON-451587206</nova:project>
Nov 29 14:44:31 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:root type="image" uuid="1c1f5b82-9297-44c0-82c9-08c454893445"/>
Nov 29 14:44:31 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:31 user nova-compute[75215]:         <nova:port uuid="7ac9dc69-7478-419e-b800-96c16c9a67bc">
Nov 29 14:44:31 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 14:44:31 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:31 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:31 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:31 user nova-compute[75215]:   </metadata>
Nov 29 14:44:31 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:31 user nova-compute[75215]:     <system>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="serial">bebb8ca0-07ba-4d7d-b446-33faf800b6ff</entry>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="uuid">bebb8ca0-07ba-4d7d-b446-33faf800b6ff</entry>
Nov 29 14:44:31 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:31 user nova-compute[75215]:     </system>
Nov 29 14:44:31 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:31 user nova-compute[75215]:   <os>
Nov 29 14:44:31 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:31 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:31 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:31 user nova-compute[75215]:   </os>
Nov 29 14:44:31 user nova-compute[75215]:   <features>
Nov 29 14:44:31 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:31 user nova-compute[75215]:     <apic/>
Nov 29 14:44:31 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:31 user nova-compute[75215]:   </features>
Nov 29 14:44:31 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:31 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:31 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:31 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:31 user nova-compute[75215]:   </clock>
Nov 29 14:44:31 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:31 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:31 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:31 user nova-compute[75215]:   </cpu>
Nov 29 14:44:31 user nova-compute[75215]:   <devices>
Nov 29 14:44:31 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:31 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:31 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk"/>
Nov 29 14:44:31 user nova-compute[75215]:       <target dev="sda" bus="scsi"/>
Nov 29 14:44:31 user nova-compute[75215]:       <address type="drive" controller="0" unit="0"/>
Nov 29 14:44:31 user nova-compute[75215]:     </disk>
Nov 29 14:44:31 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 29 14:44:31 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 14:44:31 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.config"/>
Nov 29 14:44:31 user nova-compute[75215]:       <target dev="sdb" bus="scsi"/>
Nov 29 14:44:31 user nova-compute[75215]:       <address type="drive" controller="0" unit="1"/>
Nov 29 14:44:31 user nova-compute[75215]:     </disk>
Nov 29 14:44:31 user nova-compute[75215]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 14:44:31 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:31 user nova-compute[75215]:       <mac address="fa:16:3e:62:c9:f1"/>
Nov 29 14:44:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:31 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:31 user nova-compute[75215]:       <target dev="tap7ac9dc69-74"/>
Nov 29 14:44:31 user nova-compute[75215]:     </interface>
Nov 29 14:44:31 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:31 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/console.log" append="off"/>
Nov 29 14:44:31 user nova-compute[75215]:     </serial>
Nov 29 14:44:31 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:31 user nova-compute[75215]:     <video>
Nov 29 14:44:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:31 user nova-compute[75215]:     </video>
Nov 29 14:44:31 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:31 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:31 user nova-compute[75215]:     </rng>
Nov 29 14:44:31 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:31 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:31 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:31 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:31 user nova-compute[75215]:   </devices>
Nov 29 14:44:31 user nova-compute[75215]: </domain>
Nov 29 14:44:31 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1920352381',display_name='tempest-AttachSCSIVolumeTestJSON-server-1920352381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1920352381',id=4,image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+N9u0XyDqUOQjMmX/L6lW7nl5BGkpfVmHCirwidW8H+hrcFefVWd8Xjc/NmixvFZhOcZXoN56APkvJiE1148owDCYra0iqnsgSxwGz8TsAT6TtPDIxw/RwXiNo9iLB9w==',key_name='tempest-keypair-1961959538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5cee1d9633347bbb6ada4841f2bbb78',ramdisk_id='',reservation_id='r-o4ac2gd1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-451587206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-451587206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='787e570bb87c4528a6e117e3b390e7bb',uuid=bebb8ca0-07ba-4d7d-b446-33faf800b6ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converting VIF {"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG os_vif [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec5a0e4c-171b-5df3-8920-34b56f8063a4', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac9dc69-74, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ac9dc69-74, col_values=(('qos', UUID('a23bc13c-227e-41d6-a512-7813820ef0e6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ac9dc69-74, col_values=(('external_ids', {'iface-id': '7ac9dc69-7478-419e-b800-96c16c9a67bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:c9:f1', 'vm-uuid': 'bebb8ca0-07ba-4d7d-b446-33faf800b6ff'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:31 user nova-compute[75215]: INFO os_vif [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74')
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No BDM found with device name sda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No VIF found with MAC fa:16:3e:62:c9:f1, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Using config drive
Nov 29 14:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updated VIF entry in instance network info cache for port 7ac9dc69-7478-419e-b800-96c16c9a67bc. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updating instance_info_cache with network_info: [{"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Creating config drive at /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.config
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvr61x2tk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc68c8e3-3346-48cf-b811-a6424120c3ae req-1814ca8f-2c55-445f-b3ec-c906016911a5 service nova] Releasing lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:32 user nova-compute[75215]: INFO nova.compute.claims [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Claim successful on node user
Nov 29 14:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvr61x2tk" returned: 0 in 0.134s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.policy [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd6a80f6b20b43949002e417e3886f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaaf624add446fafb9e263a766959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Creating image(s)
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "/opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "/opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "/opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.247s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk 1073741824" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.423s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.289s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Cannot resize image /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Ensure instance console log exists: /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Successfully created port: de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Successfully updated port: de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquired lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-changed-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Refreshing instance network info cache due to event network-changed-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] Acquiring lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:37 user nova-compute[75215]: INFO nova.compute.claims [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Claim successful on node user
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating instance_info_cache with network_info: [{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Releasing lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Instance network_info: |[{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] Acquired lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Refreshing network info cache for port de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Start _get_guest_xml network_info=[{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2140701016',display_name='tempest-VolumesAdminNegativeTest-server-2140701016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2140701016',id=5,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu6Rkn0fOMguWoM0JOdq4EH0Dtw6qd488wFZGYanT5f4X2AWVWl9vwxwYWfasvnUIPc6BFHx+wvro3IgzpHm3Opdiy74F38X51OrpLpk85HtcMgEahH80tVSkU7dd0/eg==',key_name='tempest-keypair-2139855903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-za54q81g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd6a80f6b20b43949002e417e3886f88',uuid=003296b4-4960-4814-b48c-ddd133e060a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'pci_devices' on Instance uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:37 user nova-compute[75215]:   <uuid>003296b4-4960-4814-b48c-ddd133e060a8</uuid>
Nov 29 14:44:37 user nova-compute[75215]:   <name>instance-00000005</name>
Nov 29 14:44:37 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:37 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:37 user nova-compute[75215]:   <metadata>
Nov 29 14:44:37 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:37 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2140701016</nova:name>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:37</nova:creationTime>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:37 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:37 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:user uuid="bd6a80f6b20b43949002e417e3886f88">tempest-VolumesAdminNegativeTest-131765768-project-member</nova:user>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:project uuid="aecaaf624add446fafb9e263a766959e">tempest-VolumesAdminNegativeTest-131765768</nova:project>
Nov 29 14:44:37 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:37 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:37 user nova-compute[75215]:         <nova:port uuid="de8e0a5d-3e5e-4cdc-bba3-fe912260f0df">
Nov 29 14:44:37 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:44:37 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:37 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:37 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:37 user nova-compute[75215]:   </metadata>
Nov 29 14:44:37 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:37 user nova-compute[75215]:     <system>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="serial">003296b4-4960-4814-b48c-ddd133e060a8</entry>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="uuid">003296b4-4960-4814-b48c-ddd133e060a8</entry>
Nov 29 14:44:37 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:37 user nova-compute[75215]:     </system>
Nov 29 14:44:37 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:37 user nova-compute[75215]:   <os>
Nov 29 14:44:37 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:37 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:37 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:37 user nova-compute[75215]:   </os>
Nov 29 14:44:37 user nova-compute[75215]:   <features>
Nov 29 14:44:37 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:37 user nova-compute[75215]:     <apic/>
Nov 29 14:44:37 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:37 user nova-compute[75215]:   </features>
Nov 29 14:44:37 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:37 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:37 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:37 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:37 user nova-compute[75215]:   </clock>
Nov 29 14:44:37 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:37 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:37 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:37 user nova-compute[75215]:   </cpu>
Nov 29 14:44:37 user nova-compute[75215]:   <devices>
Nov 29 14:44:37 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:37 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:37 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk"/>
Nov 29 14:44:37 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:37 user nova-compute[75215]:     </disk>
Nov 29 14:44:37 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:37 user nova-compute[75215]:       <mac address="fa:16:3e:e7:b6:2e"/>
Nov 29 14:44:37 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:37 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:37 user nova-compute[75215]:       <target dev="tapde8e0a5d-3e"/>
Nov 29 14:44:37 user nova-compute[75215]:     </interface>
Nov 29 14:44:37 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:37 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/console.log" append="off"/>
Nov 29 14:44:37 user nova-compute[75215]:     </serial>
Nov 29 14:44:37 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:37 user nova-compute[75215]:     <video>
Nov 29 14:44:37 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:37 user nova-compute[75215]:     </video>
Nov 29 14:44:37 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:37 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:37 user nova-compute[75215]:     </rng>
Nov 29 14:44:37 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:37 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:37 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:37 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:37 user nova-compute[75215]:   </devices>
Nov 29 14:44:37 user nova-compute[75215]: </domain>
Nov 29 14:44:37 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2140701016',display_name='tempest-VolumesAdminNegativeTest-server-2140701016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2140701016',id=5,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu6Rkn0fOMguWoM0JOdq4EH0Dtw6qd488wFZGYanT5f4X2AWVWl9vwxwYWfasvnUIPc6BFHx+wvro3IgzpHm3Opdiy74F38X51OrpLpk85HtcMgEahH80tVSkU7dd0/eg==',key_name='tempest-keypair-2139855903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-za54q81g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd6a80f6b20b43949002e417e3886f88',uuid=003296b4-4960-4814-b48c-ddd133e060a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG os_vif [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '360d0cfa-43fb-5766-9198-d574050dc42b', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde8e0a5d-3e, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde8e0a5d-3e, col_values=(('qos', UUID('a5d9acc4-bebb-4ca6-a333-ccf847c6b8b9')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde8e0a5d-3e, col_values=(('external_ids', {'iface-id': 'de8e0a5d-3e5e-4cdc-bba3-fe912260f0df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b6:2e', 'vm-uuid': '003296b4-4960-4814-b48c-ddd133e060a8'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:38 user nova-compute[75215]: INFO os_vif [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e')
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updated VIF entry in instance network info cache for port de8e0a5d-3e5e-4cdc-bba3-fe912260f0df. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating instance_info_cache with network_info: [{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Instance spawned successfully.
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-43764bdc-2100-4e41-baea-96ddf91dd1a5 req-0c48df08-4f20-4395-9c29-d4a4223127d4 service nova] Releasing lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No VIF found with MAC fa:16:3e:e7:b6:2e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.129s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.074s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:38 user nova-compute[75215]: INFO nova.compute.claims [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Claim successful on node user
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:38 user nova-compute[75215]: INFO nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Took 13.40 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:38 user nova-compute[75215]: DEBUG nova.policy [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '305d74ce2c5d45808e89090d17e4271c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daf66a83db841908f3aea8c06feed26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:38 user nova-compute[75215]: INFO nova.compute.manager [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Took 14.74 seconds to build instance.
Nov 29 14:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-634a3eab-8a97-4929-ac41-0a2d52925127 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.962s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Creating image(s)
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "/opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "/opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.274s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.256s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk 1073741824" returned: 0 in 0.100s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Creating image(s)
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "/opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "/opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "/opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.329s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.policy [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6e575c78db046d498b414e680afe3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9374847be0374c3a853e9d3a34cac7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:40 user nova-compute[75215]: WARNING nova.compute.manager [req-a4bb9464-2145-4fc5-8ba4-a099880da284 req-dfa4cabf-2d13-4c42-90b0-8ed043911f15 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state active and task_state None.
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.345s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Cannot resize image /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Ensure instance console log exists: /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.235s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Successfully created port: 6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk 1073741824" returned: 0 in 0.105s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.282s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.374s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Cannot resize image /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Ensure instance console log exists: /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Successfully created port: 8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:41 user nova-compute[75215]: INFO nova.compute.claims [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Claim successful on node user
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:42 user nova-compute[75215]: WARNING nova.compute.manager [req-f98d0c14-dfc4-4d1a-a9bc-97c95b305bad req-3f7484d8-862e-41fa-b3e2-e86f7c34d1de service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state active and task_state None.
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Successfully updated port: 6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing instance network info cache due to event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:42 user nova-compute[75215]: WARNING nova.compute.manager [req-94142d3a-7565-449a-a1cf-00293553cf30 req-1ad93462-4c26-4cf5-b752-97a36675aabd service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state active and task_state None.
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.480s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:42 user nova-compute[75215]: INFO nova.compute.claims [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Claim successful on node user
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.policy [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '919711e94a094e35829f21fe99dda832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd1c1589154bc090f15ab3dcc1f5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Creating image(s)
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Instance spawned successfully.
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Took 9.81 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.policy [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8504ddc20f4a4221a45354e756a4f125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e74b5033c0c4446b49a041e3302b44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Instance network_info: |[{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Start _get_guest_xml network_info=[{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.compute.manager [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Took 11.31 seconds to build instance.
Nov 29 14:44:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1528586113',display_name='tempest-TestStampPattern-server-1528586113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1528586113',id=6,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-saq70r90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:39Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=3f429494-a371-4b16-8659-bd56c4e7a775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-20ac8495-e8ae-479d-9714-3020c95fee08 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.523s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.305s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:43 user nova-compute[75215]:   <uuid>3f429494-a371-4b16-8659-bd56c4e7a775</uuid>
Nov 29 14:44:43 user nova-compute[75215]:   <name>instance-00000006</name>
Nov 29 14:44:43 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:43 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:43 user nova-compute[75215]:   <metadata>
Nov 29 14:44:43 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:43 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:name>tempest-TestStampPattern-server-1528586113</nova:name>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:43</nova:creationTime>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:43 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:43 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:user uuid="305d74ce2c5d45808e89090d17e4271c">tempest-TestStampPattern-678480478-project-member</nova:user>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:project uuid="1daf66a83db841908f3aea8c06feed26">tempest-TestStampPattern-678480478</nova:project>
Nov 29 14:44:43 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:43 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:43 user nova-compute[75215]:         <nova:port uuid="6d29593e-5ac3-432a-ba73-08df8ba27e0a">
Nov 29 14:44:43 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:44:43 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:43 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:43 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:43 user nova-compute[75215]:   </metadata>
Nov 29 14:44:43 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:43 user nova-compute[75215]:     <system>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="serial">3f429494-a371-4b16-8659-bd56c4e7a775</entry>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="uuid">3f429494-a371-4b16-8659-bd56c4e7a775</entry>
Nov 29 14:44:43 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:43 user nova-compute[75215]:     </system>
Nov 29 14:44:43 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:43 user nova-compute[75215]:   <os>
Nov 29 14:44:43 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:43 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:43 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:43 user nova-compute[75215]:   </os>
Nov 29 14:44:43 user nova-compute[75215]:   <features>
Nov 29 14:44:43 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:43 user nova-compute[75215]:     <apic/>
Nov 29 14:44:43 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:43 user nova-compute[75215]:   </features>
Nov 29 14:44:43 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:43 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:43 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:43 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:43 user nova-compute[75215]:   </clock>
Nov 29 14:44:43 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:43 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:43 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:43 user nova-compute[75215]:   </cpu>
Nov 29 14:44:43 user nova-compute[75215]:   <devices>
Nov 29 14:44:43 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:43 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:43 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk"/>
Nov 29 14:44:43 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:43 user nova-compute[75215]:     </disk>
Nov 29 14:44:43 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:43 user nova-compute[75215]:       <mac address="fa:16:3e:c3:c2:b9"/>
Nov 29 14:44:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:43 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:43 user nova-compute[75215]:       <target dev="tap6d29593e-5a"/>
Nov 29 14:44:43 user nova-compute[75215]:     </interface>
Nov 29 14:44:43 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:43 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/console.log" append="off"/>
Nov 29 14:44:43 user nova-compute[75215]:     </serial>
Nov 29 14:44:43 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:43 user nova-compute[75215]:     <video>
Nov 29 14:44:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:43 user nova-compute[75215]:     </video>
Nov 29 14:44:43 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:43 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:43 user nova-compute[75215]:     </rng>
Nov 29 14:44:43 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:43 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:43 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:43 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:43 user nova-compute[75215]:   </devices>
Nov 29 14:44:43 user nova-compute[75215]: </domain>
Nov 29 14:44:43 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1528586113',display_name='tempest-TestStampPattern-server-1528586113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1528586113',id=6,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-saq70r90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:39Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=3f429494-a371-4b16-8659-bd56c4e7a775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG os_vif [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1992c545-9a02-5e5d-84be-650d9fed42e9', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk 1073741824" returned: 0 in 0.093s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:44:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Creating image(s)
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "/opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "/opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Successfully updated port: 8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquired lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d29593e-5a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d29593e-5a, col_values=(('qos', UUID('897b70c1-23e8-402c-91cd-24f28c3b260a')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d29593e-5a, col_values=(('external_ids', {'iface-id': '6d29593e-5ac3-432a-ba73-08df8ba27e0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:c2:b9', 'vm-uuid': '3f429494-a371-4b16-8659-bd56c4e7a775'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:43 user nova-compute[75215]: INFO os_vif [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a')
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.289s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No VIF found with MAC fa:16:3e:c3:c2:b9, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.298s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Cannot resize image /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Ensure instance console log exists: /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Successfully created port: de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk 1073741824" returned: 0 in 0.060s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-changed-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Refreshing instance network info cache due to event network-changed-8f1949fd-f68f-42dc-93ec-f7742629332e. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] Acquiring lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:44 user nova-compute[75215]: WARNING nova.compute.manager [req-77bbd00c-d39a-49b9-b048-1610932509d4 req-68a27ea8-ce29-4315-b4f5-dd8025c29daf service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state active and task_state None.
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updated VIF entry in instance network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1c4a9166-04aa-4f35-974e-5ff4072e5b3b req-298a5d9d-39b1-4f19-8a29-c30087b32e83 service nova] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Cannot resize image /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Ensure instance console log exists: /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating instance_info_cache with network_info: [{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Successfully created port: 372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Releasing lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Instance network_info: |[{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] Acquired lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Refreshing network info cache for port 8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Start _get_guest_xml network_info=[{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2011519197',display_name='tempest-TestVolumeSwap-server-2011519197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2011519197',id=7,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAd4maefoGLi4v5c/ccGJfh7kNuG9NEyvhZa6yla6O8W0c6fh9d/4N3acdRDiw/aeDugWvOlNaEu7WA7Io2uSp6VFs4jnIPv6WTmw8zEjGyIbilQGvfs9b2qqYzrnwK3w==',key_name='tempest-keypair-898194672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9374847be0374c3a853e9d3a34cac7e7',ramdisk_id='',reservation_id='r-5lhbtvq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1379538774',owner_user_name='tempest-TestVolumeSwap-1379538774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6e575c78db046d498b414e680afe3eb',uuid=d170452a-01be-41dc-ae3e-3950ace74907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converting VIF {"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lazy-loading 'pci_devices' on Instance uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:45 user nova-compute[75215]:   <uuid>d170452a-01be-41dc-ae3e-3950ace74907</uuid>
Nov 29 14:44:45 user nova-compute[75215]:   <name>instance-00000007</name>
Nov 29 14:44:45 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:45 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:45 user nova-compute[75215]:   <metadata>
Nov 29 14:44:45 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:45 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:name>tempest-TestVolumeSwap-server-2011519197</nova:name>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:45</nova:creationTime>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:45 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:45 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:user uuid="b6e575c78db046d498b414e680afe3eb">tempest-TestVolumeSwap-1379538774-project-member</nova:user>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:project uuid="9374847be0374c3a853e9d3a34cac7e7">tempest-TestVolumeSwap-1379538774</nova:project>
Nov 29 14:44:45 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:45 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:45 user nova-compute[75215]:         <nova:port uuid="8f1949fd-f68f-42dc-93ec-f7742629332e">
Nov 29 14:44:45 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:44:45 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:45 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:45 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:45 user nova-compute[75215]:   </metadata>
Nov 29 14:44:45 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:45 user nova-compute[75215]:     <system>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="serial">d170452a-01be-41dc-ae3e-3950ace74907</entry>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="uuid">d170452a-01be-41dc-ae3e-3950ace74907</entry>
Nov 29 14:44:45 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:45 user nova-compute[75215]:     </system>
Nov 29 14:44:45 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:45 user nova-compute[75215]:   <os>
Nov 29 14:44:45 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:45 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:45 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:45 user nova-compute[75215]:   </os>
Nov 29 14:44:45 user nova-compute[75215]:   <features>
Nov 29 14:44:45 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:45 user nova-compute[75215]:     <apic/>
Nov 29 14:44:45 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:45 user nova-compute[75215]:   </features>
Nov 29 14:44:45 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:45 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:45 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:45 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:45 user nova-compute[75215]:   </clock>
Nov 29 14:44:45 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:45 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:45 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:45 user nova-compute[75215]:   </cpu>
Nov 29 14:44:45 user nova-compute[75215]:   <devices>
Nov 29 14:44:45 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:45 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:45 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk"/>
Nov 29 14:44:45 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:45 user nova-compute[75215]:     </disk>
Nov 29 14:44:45 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:45 user nova-compute[75215]:       <mac address="fa:16:3e:4e:58:52"/>
Nov 29 14:44:45 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:45 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:45 user nova-compute[75215]:       <target dev="tap8f1949fd-f6"/>
Nov 29 14:44:45 user nova-compute[75215]:     </interface>
Nov 29 14:44:45 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:45 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/console.log" append="off"/>
Nov 29 14:44:45 user nova-compute[75215]:     </serial>
Nov 29 14:44:45 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:45 user nova-compute[75215]:     <video>
Nov 29 14:44:45 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:45 user nova-compute[75215]:     </video>
Nov 29 14:44:45 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:45 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:45 user nova-compute[75215]:     </rng>
Nov 29 14:44:45 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:45 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:45 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:45 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:45 user nova-compute[75215]:   </devices>
Nov 29 14:44:45 user nova-compute[75215]: </domain>
Nov 29 14:44:45 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2011519197',display_name='tempest-TestVolumeSwap-server-2011519197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2011519197',id=7,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAd4maefoGLi4v5c/ccGJfh7kNuG9NEyvhZa6yla6O8W0c6fh9d/4N3acdRDiw/aeDugWvOlNaEu7WA7Io2uSp6VFs4jnIPv6WTmw8zEjGyIbilQGvfs9b2qqYzrnwK3w==',key_name='tempest-keypair-898194672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9374847be0374c3a853e9d3a34cac7e7',ramdisk_id='',reservation_id='r-5lhbtvq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1379538774',owner_user_name='tempest-TestVolumeSwap-1379538774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6e575c78db046d498b414e680afe3eb',uuid=d170452a-01be-41dc-ae3e-3950ace74907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converting VIF {"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG os_vif [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '559b3e04-b469-5326-974e-627c446154f7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1949fd-f6, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1949fd-f6, col_values=(('qos', UUID('56b94a35-cb03-4306-9a0d-7f43513d42ec')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1949fd-f6, col_values=(('external_ids', {'iface-id': '8f1949fd-f68f-42dc-93ec-f7742629332e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:58:52', 'vm-uuid': 'd170452a-01be-41dc-ae3e-3950ace74907'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:45 user nova-compute[75215]: INFO os_vif [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6')
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] No VIF found with MAC fa:16:3e:4e:58:52, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Successfully updated port: de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquired lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating instance_info_cache with network_info: [{"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Releasing lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Instance network_info: |[{"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Start _get_guest_xml network_info=[{"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-844252927',display_name='tempest-VolumesAssistedSnapshotsTest-server-844252927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-844252927',id=9,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjeCBsaItpc0cgChtuKgRqEmCSB6mqSGuu7s2rDmfjuISmCmxosSSzrqrrJ0SXCW6vdN0EKAk3lDjsBclZfk+QTBsXaUtDTdu/Fikqco0v3Momeg4DxCfsiXRuVjVhi3Q==',key_name='tempest-keypair-354500459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e74b5033c0c4446b49a041e3302b44b',ramdisk_id='',reservation_id='r-mt5nuwfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-867689237',owner_user_name='tempest-VolumesAssistedSnapshotsTest-867689237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8504ddc20f4a4221a45354e756a4f125',uuid=2fbaf950-0f62-4db3-9fcc-7cf6a388fa63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converting VIF {"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:46 user nova-compute[75215]:   <uuid>2fbaf950-0f62-4db3-9fcc-7cf6a388fa63</uuid>
Nov 29 14:44:46 user nova-compute[75215]:   <name>instance-00000009</name>
Nov 29 14:44:46 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:46 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:46 user nova-compute[75215]:   <metadata>
Nov 29 14:44:46 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:46 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-844252927</nova:name>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:46</nova:creationTime>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:46 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:46 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:user uuid="8504ddc20f4a4221a45354e756a4f125">tempest-VolumesAssistedSnapshotsTest-867689237-project-member</nova:user>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:project uuid="4e74b5033c0c4446b49a041e3302b44b">tempest-VolumesAssistedSnapshotsTest-867689237</nova:project>
Nov 29 14:44:46 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:46 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:46 user nova-compute[75215]:         <nova:port uuid="de4a691a-0940-4b8c-a811-b19c29eda308">
Nov 29 14:44:46 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 14:44:46 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:46 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:46 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:46 user nova-compute[75215]:   </metadata>
Nov 29 14:44:46 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:46 user nova-compute[75215]:     <system>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="serial">2fbaf950-0f62-4db3-9fcc-7cf6a388fa63</entry>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="uuid">2fbaf950-0f62-4db3-9fcc-7cf6a388fa63</entry>
Nov 29 14:44:46 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:46 user nova-compute[75215]:     </system>
Nov 29 14:44:46 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:46 user nova-compute[75215]:   <os>
Nov 29 14:44:46 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:46 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:46 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:46 user nova-compute[75215]:   </os>
Nov 29 14:44:46 user nova-compute[75215]:   <features>
Nov 29 14:44:46 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:46 user nova-compute[75215]:     <apic/>
Nov 29 14:44:46 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:46 user nova-compute[75215]:   </features>
Nov 29 14:44:46 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:46 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:46 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:46 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:46 user nova-compute[75215]:   </clock>
Nov 29 14:44:46 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:46 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:46 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:46 user nova-compute[75215]:   </cpu>
Nov 29 14:44:46 user nova-compute[75215]:   <devices>
Nov 29 14:44:46 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:46 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:46 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk"/>
Nov 29 14:44:46 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:46 user nova-compute[75215]:     </disk>
Nov 29 14:44:46 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:46 user nova-compute[75215]:       <mac address="fa:16:3e:f2:15:ec"/>
Nov 29 14:44:46 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:46 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:46 user nova-compute[75215]:       <target dev="tapde4a691a-09"/>
Nov 29 14:44:46 user nova-compute[75215]:     </interface>
Nov 29 14:44:46 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:46 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/console.log" append="off"/>
Nov 29 14:44:46 user nova-compute[75215]:     </serial>
Nov 29 14:44:46 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:46 user nova-compute[75215]:     <video>
Nov 29 14:44:46 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:46 user nova-compute[75215]:     </video>
Nov 29 14:44:46 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:46 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:46 user nova-compute[75215]:     </rng>
Nov 29 14:44:46 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:46 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:46 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:46 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:46 user nova-compute[75215]:   </devices>
Nov 29 14:44:46 user nova-compute[75215]: </domain>
Nov 29 14:44:46 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-844252927',display_name='tempest-VolumesAssistedSnapshotsTest-server-844252927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-844252927',id=9,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjeCBsaItpc0cgChtuKgRqEmCSB6mqSGuu7s2rDmfjuISmCmxosSSzrqrrJ0SXCW6vdN0EKAk3lDjsBclZfk+QTBsXaUtDTdu/Fikqco0v3Momeg4DxCfsiXRuVjVhi3Q==',key_name='tempest-keypair-354500459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e74b5033c0c4446b49a041e3302b44b',ramdisk_id='',reservation_id='r-mt5nuwfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-867689237',owner_user_name='tempest-VolumesAssistedSnapshotsTest-867689237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8504ddc20f4a4221a45354e756a4f125',uuid=2fbaf950-0f62-4db3-9fcc-7cf6a388fa63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converting VIF {"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG os_vif [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97cb7494-b7d1-56a5-a797-ab87af937232', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4a691a-09, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde4a691a-09, col_values=(('qos', UUID('d16a66df-6634-42ee-817e-9218a368dd56')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde4a691a-09, col_values=(('external_ids', {'iface-id': 'de4a691a-0940-4b8c-a811-b19c29eda308', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:15:ec', 'vm-uuid': '2fbaf950-0f62-4db3-9fcc-7cf6a388fa63'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: INFO os_vif [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09')
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] No VIF found with MAC fa:16:3e:f2:15:ec, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updated VIF entry in instance network info cache for port 8f1949fd-f68f-42dc-93ec-f7742629332e. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating instance_info_cache with network_info: [{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e0cc1c36-9158-45d2-a364-5204f64b01a6 req-57ad09d3-2169-4b18-9c01-3b5740d86a76 service nova] Releasing lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Successfully updated port: 372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-changed-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing instance network info cache due to event network-changed-372566fe-705b-4e33-a003-50c18348fa33. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-changed-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Refreshing instance network info cache due to event network-changed-de4a691a-0940-4b8c-a811-b19c29eda308. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] Acquiring lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] Acquired lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Refreshing network info cache for port de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Instance network_info: |[{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing network info cache for port 372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Start _get_guest_xml network_info=[{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:44:47 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:47 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'pci_devices' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:44:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:44:47 user nova-compute[75215]:   <uuid>12ca1bc5-8d9e-473b-953b-4e780e9c809c</uuid>
Nov 29 14:44:47 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 29 14:44:47 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:44:47 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:44:47 user nova-compute[75215]:   <metadata>
Nov 29 14:44:47 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:44:47 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:44:47</nova:creationTime>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:44:47 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:44:47 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:owner>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:44:47 user nova-compute[75215]:       </nova:owner>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:44:47 user nova-compute[75215]:       <nova:ports>
Nov 29 14:44:47 user nova-compute[75215]:         <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:44:47 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:44:47 user nova-compute[75215]:         </nova:port>
Nov 29 14:44:47 user nova-compute[75215]:       </nova:ports>
Nov 29 14:44:47 user nova-compute[75215]:     </nova:instance>
Nov 29 14:44:47 user nova-compute[75215]:   </metadata>
Nov 29 14:44:47 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:44:47 user nova-compute[75215]:     <system>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="serial">12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="uuid">12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:44:47 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:44:47 user nova-compute[75215]:     </system>
Nov 29 14:44:47 user nova-compute[75215]:   </sysinfo>
Nov 29 14:44:47 user nova-compute[75215]:   <os>
Nov 29 14:44:47 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:44:47 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:44:47 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:44:47 user nova-compute[75215]:   </os>
Nov 29 14:44:47 user nova-compute[75215]:   <features>
Nov 29 14:44:47 user nova-compute[75215]:     <acpi/>
Nov 29 14:44:47 user nova-compute[75215]:     <apic/>
Nov 29 14:44:47 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:44:47 user nova-compute[75215]:   </features>
Nov 29 14:44:47 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:44:47 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:44:47 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:44:47 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:44:47 user nova-compute[75215]:   </clock>
Nov 29 14:44:47 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:44:47 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:44:47 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:44:47 user nova-compute[75215]:   </cpu>
Nov 29 14:44:47 user nova-compute[75215]:   <devices>
Nov 29 14:44:47 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:44:47 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:44:47 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk"/>
Nov 29 14:44:47 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:44:47 user nova-compute[75215]:     </disk>
Nov 29 14:44:47 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 29 14:44:47 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 14:44:47 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config"/>
Nov 29 14:44:47 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 29 14:44:47 user nova-compute[75215]:     </disk>
Nov 29 14:44:47 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:44:47 user nova-compute[75215]:       <mac address="fa:16:3e:6a:4c:0f"/>
Nov 29 14:44:47 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:47 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:44:47 user nova-compute[75215]:       <target dev="tap372566fe-70"/>
Nov 29 14:44:47 user nova-compute[75215]:     </interface>
Nov 29 14:44:47 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:44:47 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log" append="off"/>
Nov 29 14:44:47 user nova-compute[75215]:     </serial>
Nov 29 14:44:47 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:44:47 user nova-compute[75215]:     <video>
Nov 29 14:44:47 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:44:47 user nova-compute[75215]:     </video>
Nov 29 14:44:47 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:44:47 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:44:47 user nova-compute[75215]:     </rng>
Nov 29 14:44:47 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:44:47 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:44:47 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:44:47 user nova-compute[75215]:     </memballoon>
Nov 29 14:44:47 user nova-compute[75215]:   </devices>
Nov 29 14:44:47 user nova-compute[75215]: </domain>
Nov 29 14:44:47 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG os_vif [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd6c1582-fe8e-539b-92de-20896ba2f907', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap372566fe-70, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap372566fe-70, col_values=(('qos', UUID('3056d5d3-34e7-48a1-b3ce-2a4d4a97d798')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap372566fe-70, col_values=(('external_ids', {'iface-id': '372566fe-705b-4e33-a003-50c18348fa33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:4c:0f', 'vm-uuid': '12ca1bc5-8d9e-473b-953b-4e780e9c809c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: INFO os_vif [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70')
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updated VIF entry in instance network info cache for port de4a691a-0940-4b8c-a811-b19c29eda308. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating instance_info_cache with network_info: [{"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No VIF found with MAC fa:16:3e:6a:4c:0f, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:44:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Using config drive
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d86468cd-9202-4eca-bac1-b36622e97424 req-31617e00-2016-4237-b2e8-ac1e880e9f44 service nova] Releasing lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:44:48 user nova-compute[75215]: INFO nova.compute.claims [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Claim successful on node user
Nov 29 14:44:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Creating config drive at /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn8zwrh3j {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn8zwrh3j" returned: 0 in 0.067s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updated VIF entry in instance network info cache for port 372566fe-705b-4e33-a003-50c18348fa33. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b5f2ac8a-cfb8-4aa2-af55-60b3c45db603 req-46b72af9-9626-40bc-9c80-1804e209b6ea service nova] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.013s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:44:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:44:49 user nova-compute[75215]: INFO nova.virt.block_device [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Booting with volume 750c2cb0-00d2-423b-b2ac-4f80811a58e5 at /dev/vda
Nov 29 14:44:49 user nova-compute[75215]: DEBUG nova.policy [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ffdcd4720648109006852e64f0d42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932cb09f754945fcae5d455d0e692306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG os_brick.utils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:44:49 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptz44ce8u/privsep.sock']
Nov 29 14:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:49 user sudo[85752]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptz44ce8u/privsep.sock
Nov 29 14:44:49 user sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 14:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Successfully created port: e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Successfully updated port: e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquired lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-changed-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Refreshing instance network info cache due to event network-changed-e387612b-0d73-403b-b9b1-8c83fe20429f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] Acquiring lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:51 user nova-compute[75215]: WARNING nova.compute.manager [req-606bb336-9069-4cb1-9e33-69661c5940b1 req-8f995845-6aea-46d3-9ebe-6f0527ac68e9 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 for instance with vm_state building and task_state spawning.
Nov 29 14:44:51 user sudo[85752]: pam_unix(sudo:session): session closed for user root
Nov 29 14:44:51 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Spawned new privsep daemon via rootwrap
Nov 29 14:44:51 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 14:44:51 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 14:44:51 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 14:44:51 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85827
Nov 29 14:44:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating instance_info_cache with network_info: [{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f202355-93e0-4941-bf64-77ff0cb6af50]: (2,) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Releasing lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance network_info: |[{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] Acquired lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Refreshing network info cache for port e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d14461-6680-442b-8f00-e5b732d9967b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: WARNING os_brick.initiator.connectors.nvmeof [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d73f95-24a0-4761-8b79-4e6a00d4a4bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b9459f-0407-40c6-bfe7-55ae2af195b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5b440-180c-428d-88c2-5fb98734220b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:44:52 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:44:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72086553-8e33-414c-b69c-5393868ca43c]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG os_brick.utils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== get_connector_properties: return (2612ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:44:52 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating existing volume attachment record: aa18d2b1-b3a5-456e-a876-93a51d909c31 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updated VIF entry in instance network info cache for port e387612b-0d73-403b-b9b1-8c83fe20429f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating instance_info_cache with network_info: [{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7a8487e-5d9e-49a0-8de3-4e4a27cacb08 req-86f0e11a-5b64-4c25-bf71-4cd32a92af5d service nova] Releasing lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Instance spawned successfully.
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:53 user nova-compute[75215]: INFO nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Took 14.61 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:53 user nova-compute[75215]: INFO nova.compute.manager [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Took 16.35 seconds to build instance.
Nov 29 14:44:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a472351e-011c-4d65-ab5c-a86ac34bc5ba tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.681s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:54 user nova-compute[75215]: WARNING nova.compute.manager [req-100bf301-e289-4459-931e-26c5cdafd8fe req-4e96107a-8f77-4cb4-ac14-c47977babc5a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 for instance with vm_state building and task_state spawning.
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Instance spawned successfully.
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Instance spawned successfully.
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Instance spawned successfully.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Took 15.27 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Took 12.04 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json" returned: 0 in 0.391s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Took 11.51 seconds to spawn the instance on the hypervisor.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Took 17.93 seconds to build instance.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2bf173ad-35da-448c-a947-3a4f8b19a707 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.164s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Took 13.58 seconds to build instance.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3b72271a-4e4c-4a18-a008-9fe224fd9377 tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.766s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:55 user nova-compute[75215]: INFO nova.compute.manager [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Took 13.31 seconds to build instance.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce290dca-5a81-4c2e-8451-a862c2708d8c tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.591s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] No waiting events found dispatching network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:55 user nova-compute[75215]: WARNING nova.compute.manager [req-a7dbd9d4-028f-4663-a76c-a7f495ca4842 req-26942a26-0426-4ba0-8a0e-98343509881b service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received unexpected event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc for instance with vm_state active and task_state None.
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.436s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.452s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] No waiting events found dispatching network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received unexpected event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc for instance with vm_state active and task_state None.
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] No waiting events found dispatching network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received unexpected event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df for instance with vm_state active and task_state None.
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] No waiting events found dispatching network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received unexpected event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df for instance with vm_state active and task_state None.
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] No waiting events found dispatching network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received unexpected event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e for instance with vm_state active and task_state None.
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] No waiting events found dispatching network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:44:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e77f9bbc-735c-4185-bb87-1209c0b08fca req-454346e9-0faf-4ca0-8a98-91727ba6b9bd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received unexpected event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e for instance with vm_state active and task_state None.
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:44:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:44:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=25.450111389160156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:00 user nova-compute[75215]: WARNING nova.compute.manager [req-4dad8ba4-1bf7-4157-a7e6-f73afe666277 req-ece2e1b7-0f2e-4bf7-9ec2-c4ee48501cd8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state None.
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d65d7f5b-65c1-46c7-be85-b72b266910ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:45:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.453s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:02 user nova-compute[75215]: WARNING nova.compute.manager [req-23cb6f7d-f17a-47d9-b8d8-aead1165c8d7 req-959a4b96-6f29-4799-abef-b135812bd7fa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state None.
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:45:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid d65d7f5b-65c1-46c7-be85-b72b266910ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:45:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Creating image(s)
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Ensure instance console log exists: /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start _get_guest_xml network_info=[{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'aa18d2b1-b3a5-456e-a876-93a51d909c31', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c83d839d-ee08-4c71-b1ce-6b235b33fbbe', 'attached_at': '', 'detached_at': '', 'volume_id': '750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'serial': '750c2cb0-00d2-423b-b2ac-4f80811a58e5'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:45:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connector [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Factory for ISCSI on None {{(pid=75215) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:03 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1faad84-c06e-4536-b88d-9cc55a61dfcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:45:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4023f7-6960-4359-ba47-5987a48ca7a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5] added
Nov 29 14:45:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33ccb8-a256-41a6-9659-b978f5b58751]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0c140-bb1f-421e-afe5-4f18a2d004a1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTAIUnGD {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updating instance_info_cache with network_info: [{"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTAIUnGD" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb3016-de99-4408-aaa0-b4ba83bde700]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTAIUnGD'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-d65d7f5b-65c1-46c7-be85-b72b266910ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e9234-2b58-4531-b0ea-8f6f261b17fd]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e63594-3573-4a61-829a-5d85a1be43ee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:45:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:45:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 14:45:03 user nova-compute[75215]: 
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af274183-7cde-4696-95c0-71f58a5276c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]
Nov 29 14:45:03 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.
Nov 29 14:45:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc537b-4634-4f11-ad81-fd2151bba08a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6063815-0c02-4656-8abc-b9424d662d04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded53336-d5c2-42b5-b8d3-b140887d39f6]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:45:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26133326163353033', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133326163353033', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1520580212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lazy-loading 'pci_devices' on Instance uuid c83d839d-ee08-4c71-b1ce-6b235b33fbbe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:45:04 user nova-compute[75215]:   <uuid>c83d839d-ee08-4c71-b1ce-6b235b33fbbe</uuid>
Nov 29 14:45:04 user nova-compute[75215]:   <name>instance-0000000a</name>
Nov 29 14:45:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:45:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:45:04 user nova-compute[75215]:   <metadata>
Nov 29 14:45:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:45:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:45:04 user nova-compute[75215]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1520580212</nova:name>
Nov 29 14:45:04 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:45:03</nova:creationTime>
Nov 29 14:45:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:45:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:45:04 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:45:04 user nova-compute[75215]:       <nova:owner>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:user uuid="46ffdcd4720648109006852e64f0d42d">tempest-ServerActionsV293TestJSON-521197919-project-member</nova:user>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:project uuid="932cb09f754945fcae5d455d0e692306">tempest-ServerActionsV293TestJSON-521197919</nova:project>
Nov 29 14:45:04 user nova-compute[75215]:       </nova:owner>
Nov 29 14:45:04 user nova-compute[75215]:       <nova:ports>
Nov 29 14:45:04 user nova-compute[75215]:         <nova:port uuid="e387612b-0d73-403b-b9b1-8c83fe20429f">
Nov 29 14:45:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 14:45:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:45:04 user nova-compute[75215]:       </nova:ports>
Nov 29 14:45:04 user nova-compute[75215]:     </nova:instance>
Nov 29 14:45:04 user nova-compute[75215]:   </metadata>
Nov 29 14:45:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:45:04 user nova-compute[75215]:     <system>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="serial">c83d839d-ee08-4c71-b1ce-6b235b33fbbe</entry>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="uuid">c83d839d-ee08-4c71-b1ce-6b235b33fbbe</entry>
Nov 29 14:45:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:45:04 user nova-compute[75215]:     </system>
Nov 29 14:45:04 user nova-compute[75215]:   </sysinfo>
Nov 29 14:45:04 user nova-compute[75215]:   <os>
Nov 29 14:45:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:45:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:45:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:45:04 user nova-compute[75215]:   </os>
Nov 29 14:45:04 user nova-compute[75215]:   <features>
Nov 29 14:45:04 user nova-compute[75215]:     <acpi/>
Nov 29 14:45:04 user nova-compute[75215]:     <apic/>
Nov 29 14:45:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:45:04 user nova-compute[75215]:   </features>
Nov 29 14:45:04 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:45:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:45:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:45:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:45:04 user nova-compute[75215]:   </clock>
Nov 29 14:45:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:45:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:45:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:45:04 user nova-compute[75215]:   </cpu>
Nov 29 14:45:04 user nova-compute[75215]:   <devices>
Nov 29 14:45:04 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:45:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:45:04 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 14:45:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:45:04 user nova-compute[75215]:       <serial>750c2cb0-00d2-423b-b2ac-4f80811a58e5</serial>
Nov 29 14:45:04 user nova-compute[75215]:     </disk>
Nov 29 14:45:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:45:04 user nova-compute[75215]:       <mac address="fa:16:3e:53:d8:f7"/>
Nov 29 14:45:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:45:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:45:04 user nova-compute[75215]:       <target dev="tape387612b-0d"/>
Nov 29 14:45:04 user nova-compute[75215]:     </interface>
Nov 29 14:45:04 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:45:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe/console.log" append="off"/>
Nov 29 14:45:04 user nova-compute[75215]:     </serial>
Nov 29 14:45:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:45:04 user nova-compute[75215]:     <video>
Nov 29 14:45:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:45:04 user nova-compute[75215]:     </video>
Nov 29 14:45:04 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:45:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:45:04 user nova-compute[75215]:     </rng>
Nov 29 14:45:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:45:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:45:04 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:45:04 user nova-compute[75215]:     </memballoon>
Nov 29 14:45:04 user nova-compute[75215]:   </devices>
Nov 29 14:45:04 user nova-compute[75215]: </domain>
Nov 29 14:45:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1520580212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG os_vif [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30f44d9b-1172-5e19-b747-46fdc678431f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape387612b-0d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape387612b-0d, col_values=(('qos', UUID('21d23b88-62a2-4438-bfb9-bc376c0010a7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape387612b-0d, col_values=(('external_ids', {'iface-id': 'e387612b-0d73-403b-b9b1-8c83fe20429f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d8:f7', 'vm-uuid': 'c83d839d-ee08-4c71-b1ce-6b235b33fbbe'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:04 user nova-compute[75215]: INFO os_vif [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d')
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:45:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] No VIF found with MAC fa:16:3e:53:d8:f7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:45:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:45:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance spawned successfully.
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:45:09 user nova-compute[75215]: INFO nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 29 14:45:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:45:09 user nova-compute[75215]: INFO nova.compute.manager [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Took 21.09 seconds to build instance.
Nov 29 14:45:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-18074f79-31f1-4e6b-b7e3-a3672b7f9f45 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.328s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:45:10 user nova-compute[75215]: INFO nova.compute.claims [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Claim successful on node user
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.417s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:45:10 user nova-compute[75215]: INFO nova.compute.claims [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Claim successful on node user
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:45:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:45:11 user nova-compute[75215]: INFO nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Booting with volume 4659d389-95f1-4e8d-9244-368536f1347f at /dev/vda
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.policy [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a2deadfb65345c28f41e5488c438309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3d0f0a4beb48eb8eb4d3380268a11d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c57b60-066f-4a34-9ab5-49b239496796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[726857a4-8f98-4e83-8b58-16e4180cdbf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[abed5e47-d49c-41f0-ad79-ce2252f07e44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62c3ec-0220-49a1-bd3e-08660998bf9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:11 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b13e07-a4ef-4215-becf-a62b6b421627]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating existing volume attachment record: 268f2c8f-7c87-413d-9a89-ee56b6385d5b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:45:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:45:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:45:11 user nova-compute[75215]: INFO nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Booting with volume 50ebfbf3-e657-4877-b2b6-958eff0b57b4 at /dev/vda
Nov 29 14:45:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f368d-1925-48fd-8ede-9245fd4b37ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa243e1-ac19-453a-81ad-fd002209b389]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG nova.policy [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f922ff36e72437aaf3e4b9a65189144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dccd2d1a43f4aabbfce4440f4b1b04d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[450625ca-51f9-4e52-ad18-12f7bb460d48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1574648-3b9d-49d9-8007-1315cd7fbe44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:12 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[916898a3-71b6-4150-ba82-1a31b967c95e]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating existing volume attachment record: 9e7eca6b-2a00-4034-ac5a-a48f78a6678b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully created port: 8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully created port: 66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully created port: 28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] No waiting events found dispatching network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:13 user nova-compute[75215]: WARNING nova.compute.manager [req-c97734b6-3d59-46be-b9a1-c896a355e23c req-9943a5ba-98a9-4776-9a78-c22c9c0e7a9d service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received unexpected event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a for instance with vm_state active and task_state None.
Nov 29 14:45:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully created port: a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully created port: 184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully created port: 67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully created port: cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] No waiting events found dispatching network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:15 user nova-compute[75215]: WARNING nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received unexpected event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a for instance with vm_state active and task_state None.
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] No waiting events found dispatching network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:15 user nova-compute[75215]: WARNING nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received unexpected event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 for instance with vm_state active and task_state None.
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] No waiting events found dispatching network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:15 user nova-compute[75215]: WARNING nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received unexpected event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 for instance with vm_state active and task_state None.
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:15 user nova-compute[75215]: WARNING nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state None.
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:45:15 user nova-compute[75215]: WARNING nova.compute.manager [req-219da918-758b-467f-bcd3-bb8ca82d325d req-69906249-92ed-41dd-b4f4-873566f77c61 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state None.
Nov 29 14:45:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully created port: 10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully created port: 1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully created port: 4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: 8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-8b7fb46f-2367-452e-8738-845846741434. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7aa2689-ece6-4e55-a3cb-2f378a4ff022 req-e2bb0df3-0feb-4389-85ee-592882d0abbd service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: 31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-66dc7e57-bef0-4007-a45a-80aeaa7b0e70. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-653bd822-e4f9-4f94-bb69-9bb23e0cd700 req-bbc93094-c347-42d2-b3d6-7b2cff1fe2df service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-e38d58a4-34a4-4cc7-88a1-2c25c0f97045. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-31315a06-22c4-487d-888e-47d789df66b8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: 28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-763e9073-ab7e-4963-8ac0-154d87bd16b7 req-11cafa3b-2030-424f-835a-1bf21169891e service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-3c846958-280b-4134-bc9f-1d71a8895213. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-a7bafecb-a540-4ab4-a379-85898f0b67e8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f99355b6-360a-4328-a60c-56c22f667e44 req-f9efe840-9fd4-4c46-89f2-3c4504820a06 service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-67741ca5-e257-4b30-927f-cd4cf2c74b12. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: 184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6baebb48-dff5-4970-89e2-f3df26b00e9a req-7186206a-bee8-4a48-afcf-48e885a5e6df service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-10f513d4-5565-4486-b7a3-c02eaedc9434. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-184b5674-2b78-43fb-8969-f9002a50db6c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Successfully updated port: 4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5af731ea-b30c-4601-8c54-ba6a99165dc7 req-69d46116-9bb8-4b89-93be-24299ca8c524 service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a65a2c29-f6a0-49d5-8ca8-719f46670b3e req-2c68e2d4-ed70-41d1-a524-94c659afefa8 service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Successfully updated port: 1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:45:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:45:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-4c8493be-f778-44b4-9d50-b7963f0b9dda. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:27 user nova-compute[75215]: INFO nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Booting with volume 97d40410-5a9e-42cc-acd2-95e5eca013c9 at /dev/vdb
Nov 29 14:45:27 user nova-compute[75215]: INFO nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Booting with volume 7f87a8d8-4688-434d-9b13-b107bd6b6f3f at /dev/vdb
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d055e-bc5e-4187-9c49-55fb37cb6496]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1372071d-e6b8-4aa8-8629-c8efc14f0e77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[989fb4bd-fac2-4e19-add3-f8e22de86790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71b99e-a79f-44c6-9226-08d16e9c0f88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f640bd-4d17-43a7-99f9-7fac917ddfdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486b94b-7078-432c-985e-b99da2a4e9d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77530f-7865-4351-a240-0e768a9f3ef6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:27 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41f44c9-5e23-4c36-ae0c-a7e486885ba3]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f21d229-befa-4a1a-9367-f5ac90de0d4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating existing volume attachment record: 822edbb0-8eca-4deb-8199-4af29b822d3f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:27 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e3c6c-a143-4fa4-9572-b5972801367a]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating existing volume attachment record: 2381853d-6cb3-4378-bc7a-4732af169054 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance network_info: |[{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updated VIF entry in instance network info cache for port 4c8493be-f778-44b4-9d50-b7963f0b9dda. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance network_info: |[{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updated VIF entry in instance network info cache for port cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-1cb05572-fee2-4539-8065-3819fee3b342. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:45:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:30 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updated VIF entry in instance network info cache for port 1cb05572-fee2-4539-8065-3819fee3b342. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:45:30 user nova-compute[75215]: DEBUG nova.network.neutron [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e028aaf0-c7ff-42ca-ba32-f71eedc9db0c req-b5f60088-b23a-41ce-affd-d9fa9e868201 service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:42 user nova-compute[75215]: INFO nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Booting with volume ca05f6aa-e0a7-426d-90a7-51b9c21f542b at /dev/vdc
Nov 29 14:45:42 user nova-compute[75215]: INFO nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Booting with volume fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb at /dev/vdc
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6674f45e-5e00-408e-9068-f5dbcdb17b67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c32ca-e5c0-481b-98c1-d07e86ffe498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e4aa2-5ed1-4fd8-bdcf-abeaf3b0a9be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8c455-49e2-4c06-86f5-16082bd1594a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132e878-d03f-488b-ac1f-42a2f75ce2bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:42 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b4fab-1799-4682-a481-244e4ba1de08]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.utils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating existing volume attachment record: b5ce36ee-3e1f-48f3-aaa8-436867263b35 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af03ab-e4e5-4234-8a79-249b1c63863a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b2d1ea-73cd-43bf-813e-7db5a6d40122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b4af75-0aa6-422d-977e-2d03436219a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:42 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4999de-c89f-4af1-8fc7-71dcdb85584c]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:42 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating existing volume attachment record: fa495a23-dd7c-433b-96ce-e7b8078fe200 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:45:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:45:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:45:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:45:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7099MB free_disk=25.27167510986328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d65d7f5b-65c1-46c7-be85-b72b266910ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 937930ff-fe15-4b44-a8fc-7a74bd86f927 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:45:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:45:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Creating image(s)
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Ensure instance console log exists: /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Start _get_guest_xml network_info=[{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '268f2c8f-7c87-413d-9a89-ee56b6385d5b', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtamfZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937930ff-fe15-4b44-a8fc-7a74bd86f927', 'attached_at': '', 'detached_at': '', 'volume_id': '4659d389-95f1-4e8d-9244-368536f1347f', 'serial': '4659d389-95f1-4e8d-9244-368536f1347f'}, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '822edbb0-8eca-4deb-8199-4af29b822d3f', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCkmNJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937930ff-fe15-4b44-a8fc-7a74bd86f927', 'attached_at': '', 'detached_at': '', 'volume_id': '97d40410-5a9e-42cc-acd2-95e5eca013c9', 'serial': '97d40410-5a9e-42cc-acd2-95e5eca013c9'}, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b5ce36ee-3e1f-48f3-aaa8-436867263b35', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDzTPXIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937930ff-fe15-4b44-a8fc-7a74bd86f927', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 'serial': 'ca05f6aa-e0a7-426d-90a7-51b9c21f542b'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:45:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Creating image(s)
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Ensure instance console log exists: /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Start _get_guest_xml network_info=[{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9e7eca6b-2a00-4034-ac5a-a48f78a6678b', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYajquzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1567bac5-1f03-4c69-8951-f4d5c097d81c', 'attached_at': '', 'detached_at': '', 'volume_id': '50ebfbf3-e657-4877-b2b6-958eff0b57b4', 'serial': '50ebfbf3-e657-4877-b2b6-958eff0b57b4'}, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2381853d-6cb3-4378-bc7a-4732af169054', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEwZfcGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1567bac5-1f03-4c69-8951-f4d5c097d81c', 'attached_at': '', 'detached_at': '', 'volume_id': '7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 'serial': '7f87a8d8-4688-434d-9b13-b107bd6b6f3f'}, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'fa495a23-dd7c-433b-96ce-e7b8078fe200', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOUGAdvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1567bac5-1f03-4c69-8951-f4d5c097d81c', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 'serial': 'fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:45:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtamfZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:57 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYajquzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1297a44f-ac73-4b77-9ef7-b9999f57618f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:45:57 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8888f1-6bc9-4f6f-91e0-5b64919eca88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f] added
Nov 29 14:45:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[301831fb-ea8a-4586-8331-2eae5ce8f643]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9d613-dd0d-4647-aed6-0af641190ab2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtamfZsA {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtamfZsA" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f7bc01-fdf0-4d00-94a5-581601536295]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XtamfZsA'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1478145e-6ec7-4f6c-9757-c73af9f1a23f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77146c-c89a-4107-be45-3756f2c2d5a0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a1ade-c2f7-4ed6-9a59-5b2e2db515b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260]
Nov 29 14:45:57 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260] successful.
Nov 29 14:45:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ee126-b526-4c68-af4d-b050a8d06c8c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60d571-fb77-4fd4-b5ee-3f4c8652d47e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:58 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:58 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32e965-57dc-4c67-903a-9249cda61a0b]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:45:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtamfZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23231346430626135', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231346430626135', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.294s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:45:59 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b18282-ba9b-4cb4-970a-5fd85d356edb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:45:59 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCkmNJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20bdc6-ac65-48ab-b12f-c75a3ac7d526]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4] added
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd982d5-57a1-4421-918d-3fef580aaca9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1008a8-fd21-4053-92c2-9a2f8dca04a4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYajquzI {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYajquzI" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6b2b2-4f38-4333-a0a9-194a392383e3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYajquzI'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb8c5a-6525-4114-831e-9bb7105583b1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lazy-loading 'flavor' on Instance uuid d65d7f5b-65c1-46c7-be85-b72b266910ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde50995-1068-44ff-ad1f-7b4801e2b0db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75237c99-b06d-49fa-92d0-d9be76860cbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260]
Nov 29 14:45:59 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260] successful.
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab9366-a265-408e-b3b7-4681c663fc68]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6550d12f-09d4-4f1c-ae0c-90630644e4d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:45:59 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:45:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4493786-7e22-4169-9e5d-4ac691b6c71e]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYajquzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:45:59 user nova-compute[75215]: INFO nova.compute.manager [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Attaching volume a9348075-9d2c-4d83-95c2-d0d2af176fa2 to /dev/vdb
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d01bb-b34d-4eef-93d9-7f15af8fd4a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db078f0c-6eb5-48fd-a9d5-daca0f8cee68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea321881-9861-4b26-89a5-f2cf4059cfa0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85e792-b2ea-4118-9db6-2b2c670d212f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:45:59 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:45:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39d3f1-4f82-4564-a10a-9218ef20713f]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:45:59 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updating existing volume attachment record: 16c07660-9685-4532-8d87-b28e11dffa86 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== connect_volume: return (2619ms) {'type': 'block', 'scsi_wwn': '26431643166306233', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431643166306233', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:00 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edfdd5c-73d1-4a4c-8088-9f7b735d4bee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:00 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEwZfcGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11f839-e2fa-4249-884b-8648a90d9b01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9] added
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71bbacd-3ea0-4e59-a7e6-2d66a9318323]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d99aa6-bcff-4de5-acd6-b3783429b891]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCkmNJiX {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCkmNJiX" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4719c-7bc2-4e89-ab40-a955c4a391e6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCkmNJiX'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be1b64-1fd3-4ac4-af33-f2149a58b69b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb425399-bd2e-4da8-a676-35ddaea5db48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[801dcba7-5b63-4c4d-9539-01aea85f08ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260]
Nov 29 14:46:00 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d7fb51-c2fb-4374-9816-97568b6a4913]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6fa0c1-251e-411f-81c1-8dee6b1c374e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ca8c8-f15a-41bd-a241-32e030aa45ba]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCkmNJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== connect_volume: return (2620ms) {'type': 'block', 'scsi_wwn': '23935356665313165', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935356665313165', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.294s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:01 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ed459-4b73-4618-a071-bd019988f467]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:01 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDzTPXIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[670486d6-0218-4fbd-9e93-b492e95c6a8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f] added
Nov 29 14:46:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing instance network info cache due to event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0dd441-a68a-4368-b04a-672eece5bed1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43091866-5437-4f67-8d5d-16dcbcefdd97]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEwZfcGI {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEwZfcGI" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a336ce-1e06-42b7-83c9-fd402b7910e7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEwZfcGI'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe2e58-545b-4fd3-b86e-7d0fbdc1af42]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd1131-3a2d-4793-8be5-94581244e307]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46aeb1-717f-4ab9-888f-b3a78b7cfdac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260]
Nov 29 14:46:01 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df50ae3a-3b66-4d67-98ba-28b39c3a7325]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccca4f5-f6bf-4016-b1e7-8d1f738c3f18]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1826867-25fd-4458-9a21-735fc4ae01e6]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEwZfcGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updated VIF entry in instance network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd6344bc-caa8-4371-b7e8-962f4d67f7e9 req-17097468-b2ec-40f8-8ddf-35e07ed2d103 service nova] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== connect_volume: return (2637ms) {'type': 'block', 'scsi_wwn': '23634623664633734', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634623664633734', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.314s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:03 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64094bae-8f27-468e-b125-6e3166f76065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea16faf-7ce2-4fec-a1b3-d9cfbd9c74ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b] added
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOUGAdvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[695bcf4d-f942-42e2-b531-3d98b7e7a277]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb298d-ff7f-4ec2-b2fc-474c70beaf7c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDzTPXIQ {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDzTPXIQ" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ba4b3-c8ff-46df-be47-cb9881de201c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDzTPXIQ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a871e20-7e84-469e-b2bc-4cecbdf02c91]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee14d3aa-c5c1-4ce4-92fd-8afaf288953b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[990198b2-83ab-4080-8189-f47109621df7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260]
Nov 29 14:46:03 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a04446-8149-45b4-b49f-b451d8a5cd40]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f9acb-9c3b-42cd-92fa-d88f51f325cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d6327-b590-4947-8b10-0b0242ed570b]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDzTPXIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== connect_volume: return (2664ms) {'type': 'block', 'scsi_wwn': '26331656536623430', 'path': '/dev/sdg'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331656536623430', 'path': '/dev/sdg'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.289s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lazy-loading 'pci_devices' on Instance uuid 937930ff-fe15-4b44-a8fc-7a74bd86f927 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63514c24-6d5a-43c7-833d-28a9fbe743f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-changed-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing instance network info cache due to event network-changed-53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing network info cache for port 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:46:04 user nova-compute[75215]:   <uuid>937930ff-fe15-4b44-a8fc-7a74bd86f927</uuid>
Nov 29 14:46:04 user nova-compute[75215]:   <name>instance-0000000b</name>
Nov 29 14:46:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:46:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:46:04 user nova-compute[75215]:   <metadata>
Nov 29 14:46:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:46:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-1134667568</nova:name>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:45:57</nova:creationTime>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:46:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:46:04 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:owner>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:user uuid="7a2deadfb65345c28f41e5488c438309">tempest-TaggedBootDevicesTest_v242-1966625572-project-member</nova:user>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:project uuid="ab3d0f0a4beb48eb8eb4d3380268a11d">tempest-TaggedBootDevicesTest_v242-1966625572</nova:project>
Nov 29 14:46:04 user nova-compute[75215]:       </nova:owner>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:46:04 user nova-compute[75215]:       <nova:ports>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="8b7fb46f-2367-452e-8738-845846741434">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="e38d58a4-34a4-4cc7-88a1-2c25c0f97045">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="31315a06-22c4-487d-888e-47d789df66b8">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="184b5674-2b78-43fb-8969-f9002a50db6c">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:         <nova:port uuid="1cb05572-fee2-4539-8065-3819fee3b342">
Nov 29 14:46:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 14:46:04 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:04 user nova-compute[75215]:       </nova:ports>
Nov 29 14:46:04 user nova-compute[75215]:     </nova:instance>
Nov 29 14:46:04 user nova-compute[75215]:   </metadata>
Nov 29 14:46:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:46:04 user nova-compute[75215]:     <system>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="serial">937930ff-fe15-4b44-a8fc-7a74bd86f927</entry>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="uuid">937930ff-fe15-4b44-a8fc-7a74bd86f927</entry>
Nov 29 14:46:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:46:04 user nova-compute[75215]:     </system>
Nov 29 14:46:04 user nova-compute[75215]:   </sysinfo>
Nov 29 14:46:04 user nova-compute[75215]:   <os>
Nov 29 14:46:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:46:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:46:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:46:04 user nova-compute[75215]:   </os>
Nov 29 14:46:04 user nova-compute[75215]:   <features>
Nov 29 14:46:04 user nova-compute[75215]:     <acpi/>
Nov 29 14:46:04 user nova-compute[75215]:     <apic/>
Nov 29 14:46:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:46:04 user nova-compute[75215]:   </features>
Nov 29 14:46:04 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:46:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:46:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:46:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:46:04 user nova-compute[75215]:   </clock>
Nov 29 14:46:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:46:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:46:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:46:04 user nova-compute[75215]:   </cpu>
Nov 29 14:46:04 user nova-compute[75215]:   <devices>
Nov 29 14:46:04 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 29 14:46:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 14:46:04 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/disk.config"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 29 14:46:04 user nova-compute[75215]:     </disk>
Nov 29 14:46:04 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:04 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <serial>4659d389-95f1-4e8d-9244-368536f1347f</serial>
Nov 29 14:46:04 user nova-compute[75215]:     </disk>
Nov 29 14:46:04 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:04 user nova-compute[75215]:       <source dev="/dev/sde"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <serial>97d40410-5a9e-42cc-acd2-95e5eca013c9</serial>
Nov 29 14:46:04 user nova-compute[75215]:     </disk>
Nov 29 14:46:04 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:04 user nova-compute[75215]:       <source dev="/dev/sdg"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <serial>ca05f6aa-e0a7-426d-90a7-51b9c21f542b</serial>
Nov 29 14:46:04 user nova-compute[75215]:     </disk>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:4a:3d:e2"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tap8b7fb46f-23"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:ff:e9:48"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tape38d58a4-34"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:ea:33:d8"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tap31315a06-22"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:88:06:7b"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tap28bc5a8f-f5"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:73:e4:30"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tap184b5674-2b"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:f7:ba:fe"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tapcd68b80a-ea"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:04 user nova-compute[75215]:       <mac address="fa:16:3e:ad:d8:fa"/>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:04 user nova-compute[75215]:       <target dev="tap1cb05572-fe"/>
Nov 29 14:46:04 user nova-compute[75215]:     </interface>
Nov 29 14:46:04 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:46:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/console.log" append="off"/>
Nov 29 14:46:04 user nova-compute[75215]:     </serial>
Nov 29 14:46:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:46:04 user nova-compute[75215]:     <video>
Nov 29 14:46:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:04 user nova-compute[75215]:     </video>
Nov 29 14:46:04 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:46:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:46:04 user nova-compute[75215]:     </rng>
Nov 29 14:46:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:46:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:46:04 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:46:04 user nova-compute[75215]:     </memballoon>
Nov 29 14:46:04 user nova-compute[75215]:   </devices>
Nov 29 14:46:04 user nova-compute[75215]: </domain>
Nov 29 14:46:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b940ae99-6f2a-5745-acd7-076005f4eba8', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2246af57-baee-41ea-bcca-d665a08b1911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb] added
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b7fb46f-23, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b7fb46f-23, col_values=(('qos', UUID('d009c46e-ba37-4972-99a4-96cf7309b719')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b7fb46f-23, col_values=(('external_ids', {'iface-id': '8b7fb46f-2367-452e-8738-845846741434', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:3d:e2', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23')
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf51cac-2c8f-4fed-9b60-7fe2b6ecf527]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2948043f-ed66-5df4-ad77-4e6413db5735', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape38d58a4-34, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape38d58a4-34, col_values=(('qos', UUID('b271a2a0-91a8-4f65-97af-ccbedbfe2925')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape38d58a4-34, col_values=(('external_ids', {'iface-id': 'e38d58a4-34a4-4cc7-88a1-2c25c0f97045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:e9:48', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a14893-2a55-4945-baab-07b9c25d37f6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOUGAdvF {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34')
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOUGAdvF" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47fed733-210b-547e-805d-18807807878c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd5d12a-83fa-417c-abd7-79302dc96dfe]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOUGAdvF'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31315a06-22, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31315a06-22, col_values=(('qos', UUID('74def208-c880-40a3-837a-fb3562b841ab')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31315a06-22, col_values=(('external_ids', {'iface-id': '31315a06-22c4-487d-888e-47d789df66b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:33:d8', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0232856-8db0-40f1-a57e-d7636c645366]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a0d56b-d7d6-4b0c-9172-840e77340f15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22')
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b81e1e8a-efe1-5705-aaba-8c215a574dd4', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28bc5a8f-f5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28bc5a8f-f5, col_values=(('qos', UUID('c5df089f-1855-41ce-a085-c45e9a4ec48d')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28bc5a8f-f5, col_values=(('external_ids', {'iface-id': '28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:06:7b', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f287f7-e92d-48b3-97dc-5006aa2ea605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260]
Nov 29 14:46:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5')
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7365dc03-1d46-5252-a187-405d8b1d66c9', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b25f4b-b604-4b9b-92ca-cfba57f8bbde]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ef4d2f-fbca-4d56-8b30-33b6b2f0d110]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:04 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap184b5674-2b, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap184b5674-2b, col_values=(('qos', UUID('cca06f72-aa99-42c6-8955-ac7ada6d656c')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap184b5674-2b, col_values=(('external_ids', {'iface-id': '184b5674-2b78-43fb-8969-f9002a50db6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e4:30', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab194448-0125-4e54-ad20-37be194c663d]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOUGAdvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b')
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '611f5b90-0620-5bb4-bedf-59b7fa0a581e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd68b80a-ea, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd68b80a-ea, col_values=(('qos', UUID('56b9a72b-6dbc-432d-9d05-a5ccbef3c6cb')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd68b80a-ea, col_values=(('external_ids', {'iface-id': 'cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:ba:fe', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea')
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49c8301b-6ea6-5ef5-9eab-6c1c16d75cb1', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updated VIF entry in instance network info cache for port 53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aad7e3a5-f7f8-499a-b841-b33d73b4dded req-cabca4cb-4627-42b5-97cb-1c16ed162733 service nova] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb05572-fe, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cb05572-fe, col_values=(('qos', UUID('cf04edb7-7f6f-461e-b658-908225971168')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cb05572-fe, col_values=(('external_ids', {'iface-id': '1cb05572-fee2-4539-8065-3819fee3b342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d8:fa', 'vm-uuid': '937930ff-fe15-4b44-a8fc-7a74bd86f927'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: INFO os_vif [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe')
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] No VIF found with MAC fa:16:3e:4a:3d:e2, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] No VIF found with MAC fa:16:3e:73:e4:30, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Using config drive
Nov 29 14:46:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Creating config drive at /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/disk.config
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo293ok3h {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo293ok3h" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:05 user nova-compute[75215]: INFO nova.compute.manager [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] instance snapshotting
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:05 user nova-compute[75215]: INFO nova.compute.manager [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Shelving
Nov 29 14:46:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Beginning live snapshot process
Nov 29 14:46:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== connect_volume: return (2748ms) {'type': 'block', 'scsi_wwn': '26365366366616363', 'path': '/dev/sdh'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365366366616363', 'path': '/dev/sdh'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lazy-loading 'pci_devices' on Instance uuid 1567bac5-1f03-4c69-8951-f4d5c097d81c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:46:05 user nova-compute[75215]:   <uuid>1567bac5-1f03-4c69-8951-f4d5c097d81c</uuid>
Nov 29 14:46:05 user nova-compute[75215]:   <name>instance-0000000c</name>
Nov 29 14:46:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:46:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:46:05 user nova-compute[75215]:   <metadata>
Nov 29 14:46:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:46:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-1225976930</nova:name>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:45:57</nova:creationTime>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:46:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:46:05 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:owner>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:user uuid="1f922ff36e72437aaf3e4b9a65189144">tempest-TaggedBootDevicesTest-2130810757-project-member</nova:user>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:project uuid="1dccd2d1a43f4aabbfce4440f4b1b04d">tempest-TaggedBootDevicesTest-2130810757</nova:project>
Nov 29 14:46:05 user nova-compute[75215]:       </nova:owner>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:46:05 user nova-compute[75215]:       <nova:ports>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="66dc7e57-bef0-4007-a45a-80aeaa7b0e70">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="3c846958-280b-4134-bc9f-1d71a8895213">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="a7bafecb-a540-4ab4-a379-85898f0b67e8">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="67741ca5-e257-4b30-927f-cd4cf2c74b12">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="10f513d4-5565-4486-b7a3-c02eaedc9434">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:         <nova:port uuid="4c8493be-f778-44b4-9d50-b7963f0b9dda">
Nov 29 14:46:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 14:46:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:46:05 user nova-compute[75215]:       </nova:ports>
Nov 29 14:46:05 user nova-compute[75215]:     </nova:instance>
Nov 29 14:46:05 user nova-compute[75215]:   </metadata>
Nov 29 14:46:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:46:05 user nova-compute[75215]:     <system>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="serial">1567bac5-1f03-4c69-8951-f4d5c097d81c</entry>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="uuid">1567bac5-1f03-4c69-8951-f4d5c097d81c</entry>
Nov 29 14:46:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:46:05 user nova-compute[75215]:     </system>
Nov 29 14:46:05 user nova-compute[75215]:   </sysinfo>
Nov 29 14:46:05 user nova-compute[75215]:   <os>
Nov 29 14:46:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:46:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:46:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:46:05 user nova-compute[75215]:   </os>
Nov 29 14:46:05 user nova-compute[75215]:   <features>
Nov 29 14:46:05 user nova-compute[75215]:     <acpi/>
Nov 29 14:46:05 user nova-compute[75215]:     <apic/>
Nov 29 14:46:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:46:05 user nova-compute[75215]:   </features>
Nov 29 14:46:05 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:46:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:46:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:46:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:46:05 user nova-compute[75215]:   </clock>
Nov 29 14:46:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:46:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:46:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:46:05 user nova-compute[75215]:   </cpu>
Nov 29 14:46:05 user nova-compute[75215]:   <devices>
Nov 29 14:46:05 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 29 14:46:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 14:46:05 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/disk.config"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 29 14:46:05 user nova-compute[75215]:     </disk>
Nov 29 14:46:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:05 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <serial>50ebfbf3-e657-4877-b2b6-958eff0b57b4</serial>
Nov 29 14:46:05 user nova-compute[75215]:     </disk>
Nov 29 14:46:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:05 user nova-compute[75215]:       <source dev="/dev/sdf"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <serial>7f87a8d8-4688-434d-9b13-b107bd6b6f3f</serial>
Nov 29 14:46:05 user nova-compute[75215]:     </disk>
Nov 29 14:46:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:46:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:05 user nova-compute[75215]:       <source dev="/dev/sdh"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <serial>fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb</serial>
Nov 29 14:46:05 user nova-compute[75215]:     </disk>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:1f:78:8d"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap66dc7e57-be"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:32:b0:00"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap9aa54c26-b6"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:e6:19:09"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap3c846958-28"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:46:0b:52"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tapa7bafecb-a5"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:f5:c5:03"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap67741ca5-e2"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:fa:ed:fe"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap10f513d4-55"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:46:05 user nova-compute[75215]:       <mac address="fa:16:3e:f5:50:b1"/>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:46:05 user nova-compute[75215]:       <target dev="tap4c8493be-f7"/>
Nov 29 14:46:05 user nova-compute[75215]:     </interface>
Nov 29 14:46:05 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:46:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/console.log" append="off"/>
Nov 29 14:46:05 user nova-compute[75215]:     </serial>
Nov 29 14:46:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:46:05 user nova-compute[75215]:     <video>
Nov 29 14:46:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:46:05 user nova-compute[75215]:     </video>
Nov 29 14:46:05 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:46:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:46:05 user nova-compute[75215]:     </rng>
Nov 29 14:46:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:46:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:46:05 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:46:05 user nova-compute[75215]:     </memballoon>
Nov 29 14:46:05 user nova-compute[75215]:   </devices>
Nov 29 14:46:05 user nova-compute[75215]: </domain>
Nov 29 14:46:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '971d9897-f0d8-54cc-83ac-397a0dff73c7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66dc7e57-be, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66dc7e57-be, col_values=(('qos', UUID('e876658c-757b-48bf-b5ef-886ea8d2cdda')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66dc7e57-be, col_values=(('external_ids', {'iface-id': '66dc7e57-bef0-4007-a45a-80aeaa7b0e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:78:8d', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be')
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f8dccdb-6304-5f54-a629-6a32930a2a1e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:06 user nova-compute[75215]: WARNING nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state active and task_state shelving.
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:06 user nova-compute[75215]: WARNING nova.compute.manager [req-4d57f501-51ff-4f4d-a5d8-735d9bfa44cd req-540d1038-dce2-43a1-8340-3174c1e3653a service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state active and task_state shelving.
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470.delta 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aa54c26-b6, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aa54c26-b6, col_values=(('qos', UUID('f30cfd97-13b4-4cda-aa0b-a4ce510aae4f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aa54c26-b6, col_values=(('external_ids', {'iface-id': '9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:b0:00', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75215) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 14:46:06 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] UEFI support detected
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6')
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13339574-a5cd-5a37-b928-0aa6c572effa', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c846958-28, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c846958-28, col_values=(('qos', UUID('a0659ec6-e4c6-4b32-83ef-86056fea7c8f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c846958-28, col_values=(('external_ids', {'iface-id': '3c846958-280b-4134-bc9f-1d71a8895213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:19:09', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28')
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92964c0e-ee2d-52af-b0c6-57654c712947', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7bafecb-a5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7bafecb-a5, col_values=(('qos', UUID('e90d5da6-c2b2-4e9b-89dc-3314daf6eaf1')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7bafecb-a5, col_values=(('external_ids', {'iface-id': 'a7bafecb-a540-4ab4-a379-85898f0b67e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:0b:52', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5')
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c53ae04-b609-5a1b-9250-ad4136d5fddc', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67741ca5-e2, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67741ca5-e2, col_values=(('qos', UUID('39df233c-b114-4b05-bc42-ba3102a84e14')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67741ca5-e2, col_values=(('external_ids', {'iface-id': '67741ca5-e257-4b30-927f-cd4cf2c74b12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c5:03', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2')
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71e6da24-a9b2-50fa-8a2a-ee6c68241466', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance destroyed successfully.
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:46:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Beginning cold snapshot process
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10f513d4-55, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10f513d4-55, col_values=(('qos', UUID('cd96889f-e4fb-4284-9066-84aebf311ff9')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10f513d4-55, col_values=(('external_ids', {'iface-id': '10f513d4-5565-4486-b7a3-c02eaedc9434', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:ed:fe', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk /opt/stack/data/nova/instances/snapshots/tmponr9vrof/0be5f2078acb4096baa9582b24eac21a {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55')
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c517c0b-fac9-5c1b-ac52-45c00ddc78e5', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:46:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470.delta /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:08 user nova-compute[75215]: WARNING nova.compute.manager [req-7c926007-a896-4884-9bf7-872cb7a2947f req-7da44cb4-fd10-4fdb-84c1-afc7fb913471 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 for instance with vm_state building and task_state spawning.
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c8493be-f7, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c8493be-f7, col_values=(('qos', UUID('4529e46a-3f6b-454b-9f9a-b92a22b981e4')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c8493be-f7, col_values=(('external_ids', {'iface-id': '4c8493be-f778-44b4-9d50-b7963f0b9dda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:50:b1', 'vm-uuid': '1567bac5-1f03-4c69-8951-f4d5c097d81c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwtnDAci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:08 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0730fc-19cc-4311-b139-db0588fcdfd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:08 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.048s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e252c028-babe-4d22-ad5d-c7976187f2ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2] added
Nov 29 14:46:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cad9c3-dfdf-4565-a1a0-93a767e7aeb3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.090s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69f623-4aca-4995-87b3-347169a0244d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwtnDAci {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwtnDAci" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8620a4-e62f-44ca-a9e8-6944979cd731]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwtnDAci'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4186ba-41d5-4852-9552-b5fa16f74998]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c131a79-3484-40aa-b369-70ba996d6c1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:08 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feb1f93-c972-42a3-8963-1ec8f5f3956f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260]
Nov 29 14:46:08 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470.delta /opt/stack/data/nova/instances/snapshots/tmp2fsutxcs/dc10f96601fb4459a8f2c89cd8598470" returned: 0 in 0.682s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Snapshot extracted, beginning image upload
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk /opt/stack/data/nova/instances/snapshots/tmponr9vrof/0be5f2078acb4096baa9582b24eac21a" returned: 0 in 1.090s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Snapshot extracted, beginning image upload
Nov 29 14:46:09 user nova-compute[75215]: INFO os_vif [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7')
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfea5f1-f382-4037-a701-d0381756b5fa]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ddee8-2f30-411e-b520-dc9ad27db512]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:09 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)
Nov 29 14:46:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.571s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] No VIF found with MAC fa:16:3e:1f:78:8d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] No VIF found with MAC fa:16:3e:f5:c5:03, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Using config drive
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.083s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c0260-ae40-496a-81e9-d338d56ba8ae]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwtnDAci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:09 user nova-compute[75215]: WARNING nova.compute.manager [req-03a82f19-a72e-402a-8071-17267279b891 req-14749a7d-4db2-406b-b2d3-bf8412c1753f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 for instance with vm_state building and task_state spawning.
Nov 29 14:46:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Creating config drive at /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/disk.config
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjlzskdub {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:09 user nova-compute[75215]: WARNING nova.compute.manager [req-07a0fae4-0637-4043-ab96-cee0684774b1 req-1d5052e4-1785-442d-92ad-a714e9c07741 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee for instance with vm_state building and task_state spawning.
Nov 29 14:46:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjlzskdub" returned: 0 in 0.087s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.688s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] <== connect_volume: return (1690ms) {'type': 'block', 'scsi_wwn': '23061613363366635', 'path': '/dev/sdi'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613363366635', 'path': '/dev/sdi'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lazy-loading 'flavor' on Instance uuid d65d7f5b-65c1-46c7-be85-b72b266910ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:10 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:10 user nova-compute[75215]:   <source dev="/dev/sdi"/>
Nov 29 14:46:10 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:10 user nova-compute[75215]:   <serial>a9348075-9d2c-4d83-95c2-d0d2af176fa2</serial>
Nov 29 14:46:10 user nova-compute[75215]: </disk>
Nov 29 14:46:10 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:10 user nova-compute[75215]: WARNING nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 for instance with vm_state building and task_state spawning.
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:10 user nova-compute[75215]: WARNING nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 for instance with vm_state building and task_state spawning.
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:10 user nova-compute[75215]: WARNING nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 for instance with vm_state building and task_state spawning.
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:10 user nova-compute[75215]: WARNING nova.compute.manager [req-c99e64e2-856d-4b9c-bf0d-e49e0a0d0699 req-16bf5f8d-de1d-40e1-8050-0e1f1c0672bf service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c for instance with vm_state building and task_state spawning.
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-e427d774-1348-4e63-b06c-349c6b4f66f2 req-6430fa6d-5cc8-4f82-b2fb-8fec606dac71 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] No VIF found with MAC fa:16:3e:98:f7:47, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-814b2433-e497-4928-a857-b637b5eca731 tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.340s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:11 user nova-compute[75215]: WARNING nova.compute.manager [req-df45a841-65d4-43e9-ae20-0fdc73e28aaa req-2b895f72-2fca-4b69-bd4b-4daf82a4fae1 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 for instance with vm_state building and task_state spawning.
Nov 29 14:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Snapshot image upload complete
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.compute.manager [None req-fc03441e-3c31-4bdc-81ea-d823e027688c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Took 6.74 seconds to snapshot the instance on the hypervisor.
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Snapshot image upload complete
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.compute.manager [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Shelve offloading
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:12 user nova-compute[75215]: WARNING nova.compute.manager [req-c3ad82b9-d6d4-4e4f-943c-46470ee225e3 req-2f58813f-24e4-4dc7-a6b0-c4f884bf4721 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c for instance with vm_state building and task_state spawning.
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance destroyed successfully.
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:12 user nova-compute[75215]: INFO nova.compute.manager [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Terminating instance
Nov 29 14:46:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5da9b554-cfdf-45a4-ab20-720b27bd0c43 req-c10ef3e7-7523-4bf5-be46-a5ca6a1c3473 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f5453692-1452-44a7-8f4f-61b77123d202 req-73408d95-2d6b-4b1e-b247-e1c79fbdb1cf service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 for instance with vm_state building and task_state spawning.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance destroyed successfully.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'resources' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Instance destroyed successfully.
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lazy-loading 'resources' on Instance uuid d65d7f5b-65c1-46c7-be85-b72b266910ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwGaC1Nm9K34x9cPtaxop9xRNSgbiSQga98YJy4h636DPnKHt1Ja6uM+uXVIHV7NLv6Xoqq3YEC/jfus7jhkEve70FWsW27cfmacVN1w96sco8bHSttiv3DoNI3qLVNiQ==',key_name='tempest-keypair-786004936',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:46:12.473954',shelved_host='user',shelved_image_id='0efa234d-8b43-435e-b2a8-51f037ef7d7a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG os_vif [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1222554813',display_name='tempest-DeleteServersTestJSON-server-1222554813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1222554813',id=1,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f783ac7db93e4842b2faea3f44cedf40',ramdisk_id='',reservation_id='r-75kbfkr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1685238907',owner_user_name='tempest-DeleteServersTestJSON-1685238907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:22Z,user_data=None,user_id='12e3247c3c5043b49c90ec217ba32047',uuid=d65d7f5b-65c1-46c7-be85-b72b266910ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converting VIF {"id": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "address": "fa:16:3e:98:f7:47", "network": {"id": "97e436a5-81dc-4aff-820b-113c9941dfdf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1340874568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f783ac7db93e4842b2faea3f44cedf40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d752033-0a", "ovs_interfaceid": "9d752033-0ad5-44c1-adbb-0eb63b650ee9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG os_vif [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap115a6cca-db, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d752033-0a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74c47a8f-2b10-41e8-be0a-963804f2e843) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b1566e-8439-47f5-9781-cd8429546782) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:14 user nova-compute[75215]: INFO os_vif [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db')
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Deleting instance files /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9_del
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Deletion of /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9_del complete
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:14 user nova-compute[75215]: INFO os_vif [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=9d752033-0ad5-44c1-adbb-0eb63b650ee9,network=Network(97e436a5-81dc-4aff-820b-113c9941dfdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d752033-0a')
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwtnDAci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c3dae-3de0-4873-aa45-904dfe9fbdee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:46:14 user nova-compute[75215]: No targets found.
Nov 29 14:46:14 user nova-compute[75215]: iSNS:
Nov 29 14:46:14 user nova-compute[75215]: No targets found.
Nov 29 14:46:14 user nova-compute[75215]: STATIC:
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2
Nov 29 14:46:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:14 user nova-compute[75215]: FIRMWARE:
Nov 29 14:46:14 user nova-compute[75215]: No targets found.
Nov 29 14:46:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:46:14 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:46:14 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54fb141-849b-44cf-bd18-ef3c7471db53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22895d9d-32d4-489e-9356-1d69140c713d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:14 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 (non-flash)
Nov 29 14:46:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac4aacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2'): ({'sdi'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Removing single pathed devices sdi {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db1da5-1049-4644-8868-6d4931f9a95b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Deleted allocations for instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c74b53-54ac-4e65-9e98-72d8662fd930]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Flushing IO for device /dev/sdi {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12885f-c5cf-4a9e-9f74-ca90cddff3b6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'numa_topology' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.objects.base [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.069s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b09c7-2ef8-4fb0-b5a5-ac7bd6e6ce7f]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d8e1e7-cf68-4469-bb54-f1420dad0494]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing instance network info cache due to event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc04f565-1510-4a2b-94de-afa9b40d2054]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260]
Nov 29 14:46:14 user nova-compute[75215]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9348075-9d2c-4d83-95c2-d0d2af176fa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2be9a-0d80-4afc-9d3b-66b478aa6d76]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] <== disconnect_volume: return (462ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Deleting instance files /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca_del
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Deletion of /opt/stack/data/nova/instances/d65d7f5b-65c1-46c7-be85-b72b266910ca_del complete
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance spawned successfully.
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.compute.manager [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Took 2.03 seconds to destroy the instance on the hypervisor.
Nov 29 14:46:14 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:14 user nova-compute[75215]: INFO nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Took 17.31 seconds to spawn the instance on the hypervisor.
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:46:14 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ca4919cf-b91e-44a3-8e18-fedaa05809e8 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.343s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: INFO nova.compute.manager [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Took 64.70 seconds to build instance.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-248ac8ca-b2b5-4908-9888-59f32e92ee09 tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.841s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state active and task_state deleting.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state active and task_state deleting.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state active and task_state deleting.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-unplugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-changed-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Refreshing instance network info cache due to event network-changed-7ac9dc69-7478-419e-b800-96c16c9a67bc. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquiring lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Acquired lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Refreshing network info cache for port 7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updated VIF entry in instance network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap115a6cca-db", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb9e5f24-1389-4e44-aac3-0ba99dcd3b05 req-53697e22-ce54-4d14-b29c-90c33cbe3401 service nova] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:15 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Took 0.97 seconds to deallocate network for instance.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 for instance with vm_state building and task_state spawning.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 for instance with vm_state building and task_state spawning.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda for instance with vm_state building and task_state spawning.
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:15 user nova-compute[75215]: WARNING nova.compute.manager [req-b080b646-f5d9-4766-86a8-aa492e232640 req-5b7cf552-e254-4db5-b1b9-22394020e0b2 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda for instance with vm_state building and task_state spawning.
Nov 29 14:46:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updated VIF entry in instance network info cache for port 7ac9dc69-7478-419e-b800-96c16c9a67bc. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updating instance_info_cache with network_info: [{"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f10330a-943e-4c34-b367-c0593a1a44ca req-bc6d63a0-2831-4e74-af94-518b87bd6691 service nova] Releasing lock "refresh_cache-bebb8ca0-07ba-4d7d-b446-33faf800b6ff" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b440104-d03d-4431-97b1-6d39b0dfa399 req-591afb27-0046-4f04-98c5-48492fac3a79 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-deleted-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:16 user nova-compute[75215]: INFO nova.compute.manager [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Took 0.99 seconds to detach 1 volumes for instance.
Nov 29 14:46:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:46:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance spawned successfully.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:46:17 user nova-compute[75215]: INFO nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Took 19.90 seconds to spawn the instance on the hypervisor.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:46:17 user nova-compute[75215]: INFO nova.compute.manager [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Took 67.15 seconds to build instance.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Acquiring lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] No waiting events found dispatching network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:17 user nova-compute[75215]: WARNING nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: d65d7f5b-65c1-46c7-be85-b72b266910ca] Received unexpected event network-vif-plugged-9d752033-0ad5-44c1-adbb-0eb63b650ee9 for instance with vm_state deleted and task_state None.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:17 user nova-compute[75215]: WARNING nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 for instance with vm_state active and task_state None.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:17 user nova-compute[75215]: WARNING nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 for instance with vm_state active and task_state None.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:17 user nova-compute[75215]: WARNING nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 for instance with vm_state active and task_state None.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:17 user nova-compute[75215]: WARNING nova.compute.manager [req-37a618a4-d8dc-494d-bf6b-ddbe961a6eb6 req-29034db2-8f39-4d87-8ae1-f68183965542 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 for instance with vm_state active and task_state None.
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.634s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2d17686-d673-4b2e-98fe-5ac739497bf7 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.258s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:17 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Deleted allocations for instance d65d7f5b-65c1-46c7-be85-b72b266910ca
Nov 29 14:46:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d6f58265-bba0-4fdd-a228-278a9650524d tempest-DeleteServersTestJSON-1685238907 tempest-DeleteServersTestJSON-1685238907-project-member] Lock "d65d7f5b-65c1-46c7-be85-b72b266910ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.036s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lazy-loading 'flavor' on Instance uuid bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:18 user nova-compute[75215]: INFO nova.compute.manager [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Attaching volume 63dcb97f-48fb-4edc-bf8c-624b728a3e0e to /dev/sdc
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.utils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad69be-aac8-4292-91a6-b5c0f4f5033c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08132c9f-e309-475b-90fc-ae89c6b66806]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfa007c-5081-4aaf-971e-d50c53213df8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbd6b5-bbe1-409e-9fe7-d279b11fc4b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:18 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda188a5-513b-4e26-b912-51d5c882c750]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG os_brick.utils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:18 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updating existing volume attachment record: cf47076f-0d3d-443f-b7c8-b525bdaa6f6c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-changed-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Refreshing instance network info cache due to event network-changed-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] Acquiring lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] Acquired lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Refreshing network info cache for port de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updated VIF entry in instance network info cache for port de8e0a5d-3e5e-4cdc-bba3-fe912260f0df. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating instance_info_cache with network_info: [{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ad13752-39da-4ac4-a41b-10443fc7db51 req-32a7ff76-2884-4327-b497-7e790622e5c4 service nova] Releasing lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'flavor' on Instance uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:26 user nova-compute[75215]: INFO nova.compute.manager [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Attaching volume 04856660-bb88-4f8a-8be6-baa161181712 to /dev/vdb
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6baad2b-7f26-4ee8-8c72-02a7b83db377]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d07c5-89be-43d5-a81f-0ce9140fb1ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb3f6a-b41a-4156-8821-08d16da7b411]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7cc851-4937-4434-9d8b-1617fecd12e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:26 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d50b7-e2de-4bde-838c-d13e32cfbd9b]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating existing volume attachment record: cf2d56e6-3bed-4a5e-aea0-4c042fb1c26d {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdVUnPYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:27 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:27 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:27 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[937661ed-4bf3-4d11-a32a-65f4717ac085]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:27 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e4b04-e79a-4a87-b649-bc297da16b0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e] added
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee4c5e-859d-499e-9d61-6028cdbded12]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61859d-1a2a-4cea-9a94-af73b7f41fb4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdVUnPYh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdVUnPYh" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-changed-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Refreshing instance network info cache due to event network-changed-8f1949fd-f68f-42dc-93ec-f7742629332e. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] Acquiring lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] Acquired lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Refreshing network info cache for port 8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[229114ce-3e52-4c1c-8eff-1796a18a7da2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MdVUnPYh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4612c6-553a-45c3-ae85-70f7e71b4b19]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcd53a3-7f48-48b6-9618-f738dd68e2a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f073270-508a-4635-ba70-3049a84f30a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260]
Nov 29 14:46:27 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f50f06-2a47-4fd3-b199-bec0e9ef299a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[186631a8-8b89-4f27-b1cd-29b543ea9c5a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:27 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lazy-loading 'flavor' on Instance uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29edd14-23ef-4fef-9db3-611237b4fca5]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdVUnPYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:28 user nova-compute[75215]: INFO nova.compute.manager [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Attaching volume 53a5945d-da7d-48c9-b153-843e08352fdf to /dev/vdb
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updated VIF entry in instance network info cache for port 8f1949fd-f68f-42dc-93ec-f7742629332e. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating instance_info_cache with network_info: [{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db07af5b-6397-4b75-8045-da3c32492bdb req-27d2bf9d-15da-4720-9a69-dafdab86dff2 service nova] Releasing lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.utils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1582eb36-acef-4ba7-9439-b51bb434e025]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc85b2-6f2b-4724-8611-9cf78eebad4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[885f9d19-a1a7-456c-baa0-8556204fae61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1c2ee4-4bd1-4449-9b4b-5d29bb94cf4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:28 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba20a8ef-02b0-4924-ae0c-a18b5d0b4735]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.utils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating existing volume attachment record: 610f4889-fac6-4e53-9749-cff0904cd617 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing instance network info cache due to event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23437333035636339', 'path': '/dev/sdi'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437333035636339', 'path': '/dev/sdi'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lazy-loading 'flavor' on Instance uuid bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:29 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:29 user nova-compute[75215]:   <source dev="/dev/sdi"/>
Nov 29 14:46:29 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 29 14:46:29 user nova-compute[75215]:   <serial>63dcb97f-48fb-4edc-bf8c-624b728a3e0e</serial>
Nov 29 14:46:29 user nova-compute[75215]:   <address type="drive" controller="0" unit="2"/>
Nov 29 14:46:29 user nova-compute[75215]: </disk>
Nov 29 14:46:29 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updated VIF entry in instance network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e596d7-5e29-4655-b37d-f6b181855ac8 req-7dfbc51c-eb16-4c74-b7db-9c67908a43d3 service nova] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:29 user nova-compute[75215]: INFO nova.compute.manager [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Attaching volume 1ed855e7-b17b-434a-9edb-f67796ce66ce to /dev/vdb
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.utils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No BDM found with device name sda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] No VIF found with MAC fa:16:3e:62:c9:f1, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8625f-5b16-4bc5-80a0-6ed719374a30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b4daf-e158-4ecd-8e5d-1b0cc00a0b4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a7783-dea0-4ddd-af79-7e3ef2c51d03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb7db7-82a1-4b3e-af9c-4076d15a16b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:29 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0ddb6c-2bbb-4bdb-817c-4b03cb9341c3]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG os_brick.utils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating existing volume attachment record: 734c1a5e-3a01-48c1-8cbe-c55e05e12af3 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8c9d25-95e7-4e3e-b762-9dd8ffcf0ab4 tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.233s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-changed-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing instance network info cache due to event network-changed-372566fe-705b-4e33-a003-50c18348fa33. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing network info cache for port 372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'pci_requests' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.objects.base [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Object Instance<12ca1bc5-8d9e-473b-953b-4e780e9c809c> lazy-loaded attributes: flavor,pci_requests {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-changed-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Refreshing instance network info cache due to event network-changed-de4a691a-0940-4b8c-a811-b19c29eda308. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] Acquiring lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] Acquired lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Refreshing network info cache for port de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.policy [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '919711e94a094e35829f21fe99dda832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd1c1589154bc090f15ab3dcc1f5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updated VIF entry in instance network info cache for port 372566fe-705b-4e33-a003-50c18348fa33. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1f557860-1ac3-47da-b82f-00bff587c9f3 req-37e61283-1a88-496d-8eec-8fa1522d9ecd service nova] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updated VIF entry in instance network info cache for port de4a691a-0940-4b8c-a811-b19c29eda308. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating instance_info_cache with network_info: [{"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9453276b-ef4f-4202-b5c7-cb73b4d10f22 req-8de62998-ef11-4b52-abb4-190c9e0672d7 service nova] Releasing lock "refresh_cache-2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Successfully created port: 58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Successfully updated port: 58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-changed-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing instance network info cache due to event network-changed-58bf2726-e851-48d9-a7a2-6645c0979259. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Refreshing network info cache for port 58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG os_vif [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82c46c73-072d-5b49-b5d7-da3996b7b48b', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58bf2726-e8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58bf2726-e8, col_values=(('qos', UUID('feb27e0d-8726-4311-aacf-7eaaabe09fb2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58bf2726-e8, col_values=(('external_ids', {'iface-id': '58bf2726-e851-48d9-a7a2-6645c0979259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:52:8c', 'vm-uuid': '12ca1bc5-8d9e-473b-953b-4e780e9c809c'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: INFO os_vif [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8')
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] attach device xml: <interface type="ethernet">
Nov 29 14:46:35 user nova-compute[75215]:   <mac address="fa:16:3e:36:52:8c"/>
Nov 29 14:46:35 user nova-compute[75215]:   <model type="virtio"/>
Nov 29 14:46:35 user nova-compute[75215]:   <mtu size="1442"/>
Nov 29 14:46:35 user nova-compute[75215]:   <target dev="tap58bf2726-e8"/>
Nov 29 14:46:35 user nova-compute[75215]: </interface>
Nov 29 14:46:35 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:35 user nova-compute[75215]: WARNING nova.compute.manager [req-f2ebedda-74e0-4228-9b33-07e80773b907 req-b1be92f3-8272-4596-80ed-a3d53afd8b9e service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 for instance with vm_state active and task_state None.
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updated VIF entry in instance network info cache for port 58bf2726-e851-48d9-a7a2-6645c0979259. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e25d1407-c9da-4a43-9dad-ecf70385f32c req-8c0c303d-ddbe-4f10-8b91-d420947b312b service nova] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No VIF found with MAC fa:16:3e:6a:4c:0f, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:46:35 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:46:35</nova:creationTime>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:46:35 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:46:35 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:owner>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:46:35 user nova-compute[75215]:   </nova:owner>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:46:35 user nova-compute[75215]:   <nova:ports>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:46:35 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:46:35 user nova-compute[75215]:     </nova:port>
Nov 29 14:46:35 user nova-compute[75215]:     <nova:port uuid="58bf2726-e851-48d9-a7a2-6645c0979259">
Nov 29 14:46:35 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 29 14:46:35 user nova-compute[75215]:     </nova:port>
Nov 29 14:46:35 user nova-compute[75215]:   </nova:ports>
Nov 29 14:46:35 user nova-compute[75215]: </nova:instance>
Nov 29 14:46:35 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48e7c68f-c386-4313-93e9-9ebaf63eba3a tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.173s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvrSoiwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:36 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e19bd36-6f55-4334-acdc-bc449e52e173]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:36 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf2c32-e4f1-4d07-9ae8-c014ba67e177]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712] added
Nov 29 14:46:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.144s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc8c350-31d7-4e5b-8650-a441f6c4d10e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5667859-85b1-4171-b6be-3c077bcf78e8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvrSoiwP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvrSoiwP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d474cc40-f316-4399-9a27-89e64f5c2d42]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvrSoiwP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bfd9c9-2f34-4516-acb8-4cad5ca4d768]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lazy-loading 'flavor' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e2ad2-c488-499f-a637-eb51fdee58a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:36 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275c7fa-ae36-4c76-bbc0-4fdc1a19a139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260]
Nov 29 14:46:36 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.112s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf772a0-1200-4964-be03-705948b62ebf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7d72a-71ff-4dbe-a83a-2c8bd84b7f06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:37 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.627s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.384s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdba98b-9c8e-481f-b81c-5d021fa17661]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvrSoiwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:37 user nova-compute[75215]: WARNING nova.compute.manager [req-3ca6988b-0435-4e9b-ab0b-0827bebbd94a req-21a3cb9a-a11a-47e0-a4a7-bd41a3a9e9a4 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 for instance with vm_state active and task_state None.
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:37 user nova-compute[75215]: INFO nova.compute.manager [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Attaching volume 2a78cc68-fd21-492e-ad32-5ed4ff909caa to /dev/vdb
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:38 user nova-compute[75215]: INFO nova.compute.manager [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Attaching volume d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 to /dev/vdb
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[291e3cc9-b835-4d40-861a-29f18b0f3016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c05c9a-62ea-4bec-bc3b-5cc4dfe2d75c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99421af8-db97-4fe7-876e-4e34769083c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf4551-d83d-4e85-b1f6-6930b66000eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:38 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471cfe3-3015-4175-89c6-8a378339dbba]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating existing volume attachment record: 8b334769-af8b-49a7-a9bb-c4ad4e50864c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482afb2-6152-4dff-8e9a-e9c2a4d1b340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: INFO nova.compute.manager [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Detaching volume 63dcb97f-48fb-4edc-bf8c-624b728a3e0e
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d670626-f993-4d53-8653-78447fc71b68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1435234-e492-4284-8ada-4d497e6c5618]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433ea89-c274-42aa-bded-612d91e941a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '23462316461653732', 'path': '/dev/sdj'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462316461653732', 'path': '/dev/sdj'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'flavor' on Instance uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:38 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53accb-287a-46b1-b9e5-8a5909b5aef5]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating existing volume attachment record: 8519a0e2-dcd6-48eb-a2bb-f6a8bfe3fbe0 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:38 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:38 user nova-compute[75215]:   <source dev="/dev/sdj"/>
Nov 29 14:46:38 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:38 user nova-compute[75215]:   <serial>04856660-bb88-4f8a-8be6-baa161181712</serial>
Nov 29 14:46:38 user nova-compute[75215]: </disk>
Nov 29 14:46:38 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrgUefVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:38 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No VIF found with MAC fa:16:3e:e7:b6:2e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac69e4-3ae3-47b9-ae80-592423d02e8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:39 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19d7a8-7b47-479f-820d-dac47c66b24b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf] added
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53958034-0f26-4f99-82bd-6b4ceba2be63]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2789f0-3c75-409d-830d-114ad577f536]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrgUefVW {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrgUefVW" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77420447-8272-4feb-b0b5-76c23c8a532d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrgUefVW'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8da670-05e1-4ec4-9794-a79eedc1afd7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[007cd4a0-4d81-4728-a6e5-fc4624eeba8c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-changed-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Refreshing instance network info cache due to event network-changed-e387612b-0d73-403b-b9b1-8c83fe20429f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] Acquiring lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] Acquired lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Refreshing network info cache for port e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31580a52-437c-4c70-946d-f57dcf4b1c7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260]
Nov 29 14:46:39 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b581dda-2f03-4923-a490-9cc2bc367686]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37160a8-88f9-4e10-9f2b-b412f1400d7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:39 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c4348-a25f-4bb5-9bc1-8ece57b4e008]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrgUefVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updated VIF entry in instance network info cache for port e387612b-0d73-403b-b9b1-8c83fe20429f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating instance_info_cache with network_info: [{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b72de217-2eef-4320-a2fd-fa04a8570a02 req-7dea3cdf-8adf-4a23-b1a5-bc91a03a4805 service nova] Releasing lock "refresh_cache-c83d839d-ee08-4c71-b1ce-6b235b33fbbe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23633306530396339', 'path': '/dev/sdk'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633306530396339', 'path': '/dev/sdk'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lazy-loading 'flavor' on Instance uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:40 user nova-compute[75215]:   <source dev="/dev/sdk"/>
Nov 29 14:46:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:40 user nova-compute[75215]:   <serial>53a5945d-da7d-48c9-b153-843e08352fdf</serial>
Nov 29 14:46:40 user nova-compute[75215]: </disk>
Nov 29 14:46:40 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] No VIF found with MAC fa:16:3e:4e:58:52, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHgPLxvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:42 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0c931-b44f-4e27-a20d-1862873fdfb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351cdad-a16f-4773-bb80-92f1afa5ea43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce] added
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f8287b-42fe-4e4f-8d5a-c23b06e91c0d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dc6a4-4786-4f59-8965-ce4fc6348f9b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHgPLxvo {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHgPLxvo" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d97fb-3a26-484b-ac53-440ab0f25fd8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHgPLxvo'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0e4f7-52c1-44d2-9bdf-931c99019aeb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: INFO nova.virt.block_device [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Attempting to driver detach volume 63dcb97f-48fb-4edc-bf8c-624b728a3e0e from mountpoint /dev/sdc
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6060e-27c3-4adf-a6ea-69b8f3dfb331]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Attempting to detach device sdc from instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:42 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:42 user nova-compute[75215]:   <source dev="/dev/sdi"/>
Nov 29 14:46:42 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 29 14:46:42 user nova-compute[75215]:   <serial>63dcb97f-48fb-4edc-bf8c-624b728a3e0e</serial>
Nov 29 14:46:42 user nova-compute[75215]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 14:46:42 user nova-compute[75215]: </disk>
Nov 29 14:46:42 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Successfully detached device sdc from instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff from the persistent domain config.
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:42 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:42 user nova-compute[75215]:   <source dev="/dev/sdi"/>
Nov 29 14:46:42 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 29 14:46:42 user nova-compute[75215]:   <serial>63dcb97f-48fb-4edc-bf8c-624b728a3e0e</serial>
Nov 29 14:46:42 user nova-compute[75215]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 14:46:42 user nova-compute[75215]: </disk>
Nov 29 14:46:42 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d47b792-45e8-44d4-82aa-ebd5d2019b5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260]
Nov 29 14:46:42 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c2e02-c7b8-48fc-8dab-f2de328ad8ef]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d30989bf-4770-45c5-a7d8-35f9756b8a1c tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[173e793d-0911-4bab-bea5-3f5b42d5b1d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:42 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02663af-2835-43cc-8536-297c99bf9276]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHgPLxvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e6e68aa7-3806-437b-afad-12f1e290739e tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.616s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:46:43 user nova-compute[75215]: INFO nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Rebuilding instance
Nov 29 14:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23130633738353464', 'path': '/dev/sdl'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130633738353464', 'path': '/dev/sdl'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:43 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:43 user nova-compute[75215]:   <source dev="/dev/sdl"/>
Nov 29 14:46:43 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:43 user nova-compute[75215]:   <serial>1ed855e7-b17b-434a-9edb-f67796ce66ce</serial>
Nov 29 14:46:43 user nova-compute[75215]: </disk>
Nov 29 14:46:43 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:44 user nova-compute[75215]: WARNING nova.compute.manager [req-0ae2ef93-f26a-41b9-9232-3fee1bead9af req-c05d1252-f8cc-49d2-9243-a059ef72f32d service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state rebuilding.
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No VIF found with MAC fa:16:3e:c3:c2:b9, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.utils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270481b-487e-4b41-9630-246a76f8c813]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35930ece-52be-4350-8604-d949a6869f89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0672a8a-9b65-4e9b-8ce4-cc55384651f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[91526f53-a274-45e0-a406-54c0e185b63a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e824b9c-1186-44f9-b3c0-5ccd836347d5 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.930s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:46:44 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97a2ac-e94a-4d4c-89e8-e89b34462914]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.utils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance destroyed successfully.
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance destroyed successfully.
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1950333669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape387612b-0d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21d23b88-62a2-4438-bfb9-bc376c0010a7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.compute.manager [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Detaching volume 04856660-bb88-4f8a-8be6-baa161181712
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:46:44 user nova-compute[75215]: INFO os_vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d')
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102e6ea-3bac-4b97-b29a-c175600a411a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:46:44 user nova-compute[75215]: No targets found.
Nov 29 14:46:44 user nova-compute[75215]: iSNS:
Nov 29 14:46:44 user nova-compute[75215]: No targets found.
Nov 29 14:46:44 user nova-compute[75215]: STATIC:
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:46:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:44 user nova-compute[75215]: FIRMWARE:
Nov 29 14:46:44 user nova-compute[75215]: No targets found.
Nov 29 14:46:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:46:44 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:46:44 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa8085c-109b-4ee6-b248-22a781e792a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.compute.manager [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Swapping volume 53a5945d-da7d-48c9-b153-843e08352fdf for 160ebafb-2986-429b-a8f1-bc2200e619ad
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49ca0b-f24c-49f4-bd82-6e6943518fcd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac4ab6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b6e1d-a6f6-4f77-8cc8-c7fa844dce38]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.block_device [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Attempting to driver detach volume 04856660-bb88-4f8a-8be6-baa161181712 from mountpoint /dev/vdb
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f57ff-4a90-46b4-9556-cb90133f057d]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Attempting to detach device vdb from instance 003296b4-4960-4814-b48c-ddd133e060a8 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:44 user nova-compute[75215]:   <source dev="/dev/sdj"/>
Nov 29 14:46:44 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:44 user nova-compute[75215]:   <serial>04856660-bb88-4f8a-8be6-baa161181712</serial>
Nov 29 14:46:44 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:44 user nova-compute[75215]: </disk>
Nov 29 14:46:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully detached device vdb from instance 003296b4-4960-4814-b48c-ddd133e060a8 from the persistent domain config.
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 003296b4-4960-4814-b48c-ddd133e060a8 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:44 user nova-compute[75215]:   <source dev="/dev/sdj"/>
Nov 29 14:46:44 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:44 user nova-compute[75215]:   <serial>04856660-bb88-4f8a-8be6-baa161181712</serial>
Nov 29 14:46:44 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:44 user nova-compute[75215]: </disk>
Nov 29 14:46:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216f824-9f6a-4cef-b77b-bd03f8f09835]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13343e04-7e66-4d48-9ee7-c89d354f85cd]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26133326163353033', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3b3637', '/dev/disk/by-id/scsi-1SCST_BIOd3b3637-a32ac5039d76677e') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd868f8-38ea-420b-8ceb-87d54e8ddfd4]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88f969-4072-4e92-a6ff-5a8609820d97]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436c444-2b7e-43c3-84ca-eae3f9cf3011]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]
Nov 29 14:46:44 user nova-compute[75215]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf95f8e-80ca-4dde-87d8-c77cebd52329]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== disconnect_volume: return (388ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deleting instance files /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe_del
Nov 29 14:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deletion of /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe_del complete
Nov 29 14:46:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:46:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:46:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:46:46 user nova-compute[75215]: WARNING nova.compute.manager [req-c6b570cb-7fa6-4e15-9370-e259a79ac97a req-9a351174-3f25-4214-860a-986c8d3174f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state rebuilding.
Nov 29 14:46:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FavGlcqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:47 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:47 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:47 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb301bfd-70ff-49ab-ac75-bec89d23c8f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:47 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af49754-aad1-411a-bbc9-02e576aa6c1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa] added
Nov 29 14:46:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad8a69-1acd-4d5d-ad7c-8f060ee97f44]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63bdeb9-cc90-48fa-9cc4-34f8949bb633]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FavGlcqj {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FavGlcqj" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a7a0e-f308-4563-9c4a-dcb62cfc9017]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FavGlcqj'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[040eaf09-a86c-498a-8e4b-e50fe5f669a0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bc9d57-62e3-45b7-94c8-ba07406438a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78cd132-10cf-4afc-8a0e-d2c62c985dcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260]
Nov 29 14:46:48 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3c303-f5c4-412a-9beb-2cc333391121]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe could not be found.
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c3f87-4a81-4c8d-aabb-95a387b5663f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:48 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb31d02-3fc4-42b9-9334-3ddd3c7df83b]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMUQiKaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:46:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FavGlcqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23362656463346464', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362656463346464', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.024s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lazy-loading 'flavor' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:49 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:49 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:46:49 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:49 user nova-compute[75215]:   <serial>2a78cc68-fd21-492e-ad32-5ed4ff909caa</serial>
Nov 29 14:46:49 user nova-compute[75215]: </disk>
Nov 29 14:46:49 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da538781-b336-4d45-980e-23a9f2d5c265]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:46:49 user nova-compute[75215]: No targets found.
Nov 29 14:46:49 user nova-compute[75215]: iSNS:
Nov 29 14:46:49 user nova-compute[75215]: No targets found.
Nov 29 14:46:49 user nova-compute[75215]: STATIC:
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:46:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:46:49 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:46:49 user nova-compute[75215]: FIRMWARE:
Nov 29 14:46:49 user nova-compute[75215]: No targets found.
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:46:49 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:46:49 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47e124-8bab-424b-a8b7-75162a37b751]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a699bc3-41bf-4343-9350-2cf1b6345808]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887b75b0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== disconnect_volume: return (1120ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.669s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:46:49 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ac0ae-a9f7-4010-89ca-0abcb0d054e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:46:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bcd112-c516-4be0-9423-440eecc3e2f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1] added
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f5315d-456f-4f4f-ae34-3a0d0cbe5ca3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f154d-2e95-49cd-bfd7-80fdc914520f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMUQiKaF {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMUQiKaF" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d25b2e-6409-45d5-a01d-f639ddfcb243]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bMUQiKaF'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dcf9d8-f6fb-438c-964d-246097b76903]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71727f3-69d8-4f52-9cc0-bb2a5566b3a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6d5f1-9982-45b3-8b31-87cea2fd5227]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260]
Nov 29 14:46:49 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260] successful.
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] No VIF found with MAC fa:16:3e:f2:15:ec, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2035fa-1e91-47cf-9c5c-f4db7b705e1e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a41b0a-ca4f-4b8b-ad28-5553ca7911c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:46:49 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:46:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b5ee7f-ac73-49f8-8696-72e257f417a7]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMUQiKaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-14515160-f24d-4bd2-acf7-dc1a1c611584 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.199s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:49 user nova-compute[75215]: INFO nova.compute.manager [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Detaching volume 1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:46:49 user nova-compute[75215]: INFO nova.virt.block_device [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Attempting to driver detach volume 1ed855e7-b17b-434a-9edb-f67796ce66ce from mountpoint /dev/vdb
Nov 29 14:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Attempting to detach device vdb from instance 3f429494-a371-4b16-8659-bd56c4e7a775 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:50 user nova-compute[75215]:   <source dev="/dev/sdl"/>
Nov 29 14:46:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:50 user nova-compute[75215]:   <serial>1ed855e7-b17b-434a-9edb-f67796ce66ce</serial>
Nov 29 14:46:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:50 user nova-compute[75215]: </disk>
Nov 29 14:46:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully detached device vdb from instance 3f429494-a371-4b16-8659-bd56c4e7a775 from the persistent domain config.
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f429494-a371-4b16-8659-bd56c4e7a775 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:50 user nova-compute[75215]:   <source dev="/dev/sdl"/>
Nov 29 14:46:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:50 user nova-compute[75215]:   <serial>1ed855e7-b17b-434a-9edb-f67796ce66ce</serial>
Nov 29 14:46:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:50 user nova-compute[75215]: </disk>
Nov 29 14:46:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Preparing to wait for external event volume-reimaged-750c2cb0-00d2-423b-b2ac-4f80811a58e5 {{(pid=75215) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] volume_snapshot_create: create_info: {'snapshot_id': '4016a36c-8d8d-4234-9431-2f84dad9f2b6', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75215) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] snap xml: <domainsnapshot>
Nov 29 14:46:50 user nova-compute[75215]:   <disks>
Nov 29 14:46:50 user nova-compute[75215]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 29 14:46:50 user nova-compute[75215]:       <source file="/dev/new_file"/>
Nov 29 14:46:50 user nova-compute[75215]:     </disk>
Nov 29 14:46:50 user nova-compute[75215]:     <disk name="vda" snapshot="no"/>
Nov 29 14:46:50 user nova-compute[75215]:   </disks>
Nov 29 14:46:50 user nova-compute[75215]: </domainsnapshot>
Nov 29 14:46:50 user nova-compute[75215]:  {{(pid=75215) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] Lazy-loading 'system_metadata' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:46:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.volume.cinder [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Update attachment failed for attachment dbf03375-18a6-4638-b8ec-89e586b42920. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Failed to connect to volume 160ebafb-2986-429b-a8f1-bc2200e619ad with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907] Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     new_cinfo = self.volume_api.attachment_update(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     res = method(self, ctx, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     return method.func(obj, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     resp = self._update('/attachments/%s' % id, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907]     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.compute.manager [instance: d170452a-01be-41dc-ae3e-3950ace74907] 
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-30908fc4-6b1a-4972-b3d7-60bbeaeea39d tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] volume_snapshot_delete: delete_info: {'volume_id': '2a78cc68-fd21-492e-ad32-5ed4ff909caa'} {{(pid=75215) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-30908fc4-6b1a-4972-b3d7-60bbeaeea39d tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     if delete_info['type'] != 'qcow2':
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] KeyError: 'type'
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     rv = execute(f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     six.reraise(c, e, tb)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     raise value
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     rv = meth(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     self._volume_snapshot_create(context, instance, guest,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     rv = execute(f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     six.reraise(c, e, tb)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     raise value
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     rv = meth(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-30908fc4-6b1a-4972-b3d7-60bbeaeea39d tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-298e9ea0-d610-4464-bb76-e17162b66265)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4016a36c-8d8d-4234-9431-2f84dad9f2b6 could not be found.
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4016a36c-8d8d-4234-9431-2f84dad9f2b6 could not be found. (HTTP 404) (Request-ID: req-f40faadd-9b7e-49cd-93f7-6ba3804ea4c6)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4016a36c-8d8d-4234-9431-2f84dad9f2b6 could not be found.
Nov 29 14:46:50 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-30908fc4-6b1a-4972-b3d7-60bbeaeea39d tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] Exception during message handling: KeyError: 'type'
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-f4f0806d-39ca-4a86-b546-bdf36cd24663 tempest-VolumesAssistedSnapshotsTest-353520916 tempest-VolumesAssistedSnapshotsTest-353520916-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 6.449s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] <== connect_volume: return (2108ms) {'type': 'block', 'scsi_wwn': '23836356432613864', 'path': '/dev/sdm'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836356432613864', 'path': '/dev/sdm'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-0bca7298-9232-4c6b-ba5a-76807b76002e tempest-TestVolumeSwap-867933914 tempest-TestVolumeSwap-867933914-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e1f8473e-164f-4539-899f-a3d0b3dda79d)
Nov 29 14:46:50 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:46:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:50 user nova-compute[75215]:   <source dev="/dev/sdm"/>
Nov 29 14:46:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:50 user nova-compute[75215]:   <serial>d1b50cc5-7d57-4962-aa49-bb2da40d0fb1</serial>
Nov 29 14:46:50 user nova-compute[75215]: </disk>
Nov 29 14:46:50 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:50 user nova-compute[75215]: INFO nova.compute.manager [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Detaching volume 2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:46:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:46:51 user nova-compute[75215]: INFO nova.virt.block_device [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Attempting to driver detach volume 2a78cc68-fd21-492e-ad32-5ed4ff909caa from mountpoint /dev/vdb
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Attempting to detach device vdb from instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:51 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:51 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:46:51 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:51 user nova-compute[75215]:   <serial>2a78cc68-fd21-492e-ad32-5ed4ff909caa</serial>
Nov 29 14:46:51 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:51 user nova-compute[75215]: </disk>
Nov 29 14:46:51 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Successfully detached device vdb from instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 from the persistent domain config.
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:51 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:51 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:46:51 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:51 user nova-compute[75215]:   <serial>2a78cc68-fd21-492e-ad32-5ed4ff909caa</serial>
Nov 29 14:46:51 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:46:51 user nova-compute[75215]: </disk>
Nov 29 14:46:51 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] No VIF found with MAC fa:16:3e:6a:4c:0f, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8d85338-3657-4129-89f8-3d5109b685fa tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.386s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:46:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:53 user nova-compute[75215]: INFO nova.compute.manager [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Detaching volume d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:46:53 user nova-compute[75215]: INFO nova.virt.block_device [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Attempting to driver detach volume d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 from mountpoint /dev/vdb
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Attempting to detach device vdb from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:53 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:53 user nova-compute[75215]:   <source dev="/dev/sdm"/>
Nov 29 14:46:53 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:53 user nova-compute[75215]:   <serial>d1b50cc5-7d57-4962-aa49-bb2da40d0fb1</serial>
Nov 29 14:46:53 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 14:46:53 user nova-compute[75215]: </disk>
Nov 29 14:46:53 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully detached device vdb from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the persistent domain config.
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:46:53 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:46:53 user nova-compute[75215]:   <source dev="/dev/sdm"/>
Nov 29 14:46:53 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:46:53 user nova-compute[75215]:   <serial>d1b50cc5-7d57-4962-aa49-bb2da40d0fb1</serial>
Nov 29 14:46:53 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 14:46:53 user nova-compute[75215]: </disk>
Nov 29 14:46:53 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:46:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:46:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7364MB free_disk=25.197540283203125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 937930ff-fe15-4b44-a8fc-7a74bd86f927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:46:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:46:56 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:46:56 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:46:56 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:46:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:46:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:46:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:46:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff is timed out.
Nov 29 14:47:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Successfully detached device sdc from instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff from the live domain config.
Nov 29 14:47:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdVUnPYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4ff9a-034e-4960-a71a-a2514b672923]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:47:02 user nova-compute[75215]: No targets found.
Nov 29 14:47:02 user nova-compute[75215]: iSNS:
Nov 29 14:47:02 user nova-compute[75215]: No targets found.
Nov 29 14:47:02 user nova-compute[75215]: STATIC:
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:47:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:02 user nova-compute[75215]: FIRMWARE:
Nov 29 14:47:02 user nova-compute[75215]: No targets found.
Nov 29 14:47:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:47:02 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:47:02 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce10c477-f4bf-45ed-8a64-3c5104fb54fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b5634-ace7-4682-b65d-fc26abc75943]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:03 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887ddfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e'): ({'sdi'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Removing single pathed devices sdi {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[069f339a-1498-4d81-9024-e084713ed258]: (4, ('path checker states:\nup                  13\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[708fe173-1e01-4c8e-b87a-f96b39289e41]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Flushing IO for device /dev/sdi {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0935f-fca1-46e8-bf14-b7e4cb56888b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[67234d75-fe43-4850-af41-9fd9ebb1ea04]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf39cb-7d6a-499d-8ac5-611a3c32c429]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da06b8e-4396-430c-b55c-c2449092851b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260]
Nov 29 14:47:03 user nova-compute[75215]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dcb97f-48fb-4edc-bf8c-624b728a3e0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff887e6b-3447-4b64-83a9-b82f46bb32b2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] <== disconnect_volume: return (384ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:47:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lazy-loading 'flavor' on Instance uuid bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d85ed1b7-2392-4f96-9a7f-e2c7ede7cc3e tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.968s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 003296b4-4960-4814-b48c-ddd133e060a8 is timed out.
Nov 29 14:47:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully detached device vdb from instance 003296b4-4960-4814-b48c-ddd133e060a8 from the live domain config.
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvrSoiwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac37022-4765-4903-a03e-ee2cbd93a4b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:47:05 user nova-compute[75215]: No targets found.
Nov 29 14:47:05 user nova-compute[75215]: iSNS:
Nov 29 14:47:05 user nova-compute[75215]: No targets found.
Nov 29 14:47:05 user nova-compute[75215]: STATIC:
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:47:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:05 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:05 user nova-compute[75215]: FIRMWARE:
Nov 29 14:47:05 user nova-compute[75215]: No targets found.
Nov 29 14:47:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:47:05 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:47:05 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a8fd9-a8ca-453f-8b82-4b03825d149c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4705ba-9802-4454-80a3-53c627a8ae3b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:05 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887b6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712'): ({'sdj'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Removing single pathed devices sdj {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76d175-d522-4ec6-b048-7909b49b696f]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c403151f-6e4d-40f5-8c7f-e3d21b79bec0]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Flushing IO for device /dev/sdj {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:05 user nova-compute[75215]: INFO nova.compute.manager [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Terminating instance
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b5db9-b5f6-4425-951d-1d8553def2bf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.062s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c496c-5163-4f45-a7ba-bf6c9f339b6a]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] SCSI volumes sdj have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bec846-0059-4d29-b60e-d5d0ba112eda]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0477d9-98e0-4a58-9623-3e04e54b0ab9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260]
Nov 29 14:47:05 user nova-compute[75215]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04856660-bb88-4f8a-8be6-baa161181712 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59b2f0-4e68-4c03-8a84-39bd1ed9ec94]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] <== disconnect_volume: return (406ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-unplugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] No waiting events found dispatching network-vif-unplugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-b92b012c-ee48-41b9-a9f2-2f09d244f277 req-990f6110-4c6e-4fbe-bb7d-941e7c9bc4a7 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-unplugged-7ac9dc69-7478-419e-b800-96c16c9a67bc for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Instance destroyed successfully.
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lazy-loading 'resources' on Instance uuid bebb8ca0-07ba-4d7d-b446-33faf800b6ff {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1920352381',display_name='tempest-AttachSCSIVolumeTestJSON-server-1920352381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1920352381',id=4,image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+N9u0XyDqUOQjMmX/L6lW7nl5BGkpfVmHCirwidW8H+hrcFefVWd8Xjc/NmixvFZhOcZXoN56APkvJiE1148owDCYra0iqnsgSxwGz8TsAT6TtPDIxw/RwXiNo9iLB9w==',key_name='tempest-keypair-1961959538',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5cee1d9633347bbb6ada4841f2bbb78',ramdisk_id='',reservation_id='r-o4ac2gd1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1c1f5b82-9297-44c0-82c9-08c454893445',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-451587206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-451587206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='787e570bb87c4528a6e117e3b390e7bb',uuid=bebb8ca0-07ba-4d7d-b446-33faf800b6ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converting VIF {"id": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "address": "fa:16:3e:62:c9:f1", "network": {"id": "d15a99a1-9dd0-4b6b-8a02-e51956c004c7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1654941356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5cee1d9633347bbb6ada4841f2bbb78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac9dc69-74", "ovs_interfaceid": "7ac9dc69-7478-419e-b800-96c16c9a67bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG os_vif [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac9dc69-74, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a23bc13c-227e-41d6-a512-7813820ef0e6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:06 user nova-compute[75215]: INFO os_vif [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=7ac9dc69-7478-419e-b800-96c16c9a67bc,network=Network(d15a99a1-9dd0-4b6b-8a02-e51956c004c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac9dc69-74')
Nov 29 14:47:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Deleting instance files /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff_del
Nov 29 14:47:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Deletion of /opt/stack/data/nova/instances/bebb8ca0-07ba-4d7d-b446-33faf800b6ff_del complete
Nov 29 14:47:06 user nova-compute[75215]: INFO nova.compute.manager [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 14:47:06 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:47:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:07 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Took 0.88 seconds to deallocate network for instance.
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'flavor' on Instance uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60ec8ac7-1da3-4a4f-851e-6c13de09f52f tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.936s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:07 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Deleted allocations for instance bebb8ca0-07ba-4d7d-b446-33faf800b6ff
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] Acquiring lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] No waiting events found dispatching network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:07 user nova-compute[75215]: WARNING nova.compute.manager [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received unexpected event network-vif-plugged-7ac9dc69-7478-419e-b800-96c16c9a67bc for instance with vm_state deleted and task_state None.
Nov 29 14:47:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae5cc395-f7b0-4675-905f-ca4c3f171d54 req-dea4b181-01f8-4a34-8d2a-260a4e073905 service nova] [instance: bebb8ca0-07ba-4d7d-b446-33faf800b6ff] Received event network-vif-deleted-7ac9dc69-7478-419e-b800-96c16c9a67bc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-53442f6f-349b-4d67-a126-e07f073eb16a tempest-AttachSCSIVolumeTestJSON-451587206 tempest-AttachSCSIVolumeTestJSON-451587206-project-member] Lock "bebb8ca0-07ba-4d7d-b446-33faf800b6ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.670s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 req-2cff1e32-4dc5-4914-a9fd-a2c55955e6e4 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event volume-reimaged-750c2cb0-00d2-423b-b2ac-4f80811a58e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 req-2cff1e32-4dc5-4914-a9fd-a2c55955e6e4 service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 req-2cff1e32-4dc5-4914-a9fd-a2c55955e6e4 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 req-2cff1e32-4dc5-4914-a9fd-a2c55955e6e4 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 req-2cff1e32-4dc5-4914-a9fd-a2c55955e6e4 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Processing event volume-reimaged-750c2cb0-00d2-423b-b2ac-4f80811a58e5 {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:47:08 user nova-compute[75215]: INFO nova.virt.block_device [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Booting with volume 750c2cb0-00d2-423b-b2ac-4f80811a58e5 at /dev/vda
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.utils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417db8c-7fc0-4dee-9efd-4a8d7158e50e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dae734-a1d9-4b01-a923-10af04e00641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009f545-370b-4c4a-9054-10249215bfd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c350406-a2c0-485c-b364-b53fb24f0522]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:47:08 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:47:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[154a25be-a90c-44c9-8fc7-a5392a4ede83]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG os_brick.utils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:08 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating existing volume attachment record: 24643217-7fd3-4997-896d-b8fa0e6c5107 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f429494-a371-4b16-8659-bd56c4e7a775 is timed out.
Nov 29 14:47:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully detached device vdb from instance 3f429494-a371-4b16-8659-bd56c4e7a775 from the live domain config.
Nov 29 14:47:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHgPLxvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1783958-dfed-4b84-96b0-75df0541d569]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:47:10 user nova-compute[75215]: No targets found.
Nov 29 14:47:10 user nova-compute[75215]: iSNS:
Nov 29 14:47:10 user nova-compute[75215]: No targets found.
Nov 29 14:47:10 user nova-compute[75215]: STATIC:
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:47:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:10 user nova-compute[75215]: FIRMWARE:
Nov 29 14:47:10 user nova-compute[75215]: No targets found.
Nov 29 14:47:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:47:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:47:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d070ab-2117-4c84-924a-3c52e3782ecf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9752e8c-116b-4cc3-bdca-aaa20725acb4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:10 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88530af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce'): ({'sdl'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Removing single pathed devices sdl {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c48f9-0859-4f4a-846a-1e02b84c27b1]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd16a7-fedc-4cfe-8d3f-2bb552e45449]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flushing IO for device /dev/sdl {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc52ee1-756d-4358-9133-c579665a3b78]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e348b25-0d0a-49ed-8eb0-f69ca571efd4]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] SCSI volumes sdl have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fad0ca-92f3-4d74-9a19-de215149cf79]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3192e1dc-7041-409f-a21d-adfd415575de]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260]
Nov 29 14:47:10 user nova-compute[75215]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed855e7-b17b-434a-9edb-f67796ce66ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8266a9-96ae-4e88-bbdb-e973db719d75]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== disconnect_volume: return (366ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 is timed out.
Nov 29 14:47:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Successfully detached device vdb from instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 from the live domain config.
Nov 29 14:47:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FavGlcqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e51b39-e1f1-4fbd-9f9f-bbaabf5d650c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:47:11 user nova-compute[75215]: No targets found.
Nov 29 14:47:11 user nova-compute[75215]: iSNS:
Nov 29 14:47:11 user nova-compute[75215]: No targets found.
Nov 29 14:47:11 user nova-compute[75215]: STATIC:
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:47:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:11 user nova-compute[75215]: FIRMWARE:
Nov 29 14:47:11 user nova-compute[75215]: No targets found.
Nov 29 14:47:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:47:11 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:47:11 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca5498d-34a9-4779-83bc-b9fcaed0039f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8b7fc-42cb-4ed8-8395-8c04e387fd3b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:11 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88530790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[66112767-bbbf-4e40-8a1b-edcb6966bb60]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a0bc57-97c7-445a-b0e0-2364993b4310]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd31a4b-0a06-4f45-8be3-4590dcecfbbf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd3c2b5-4e5e-45d4-8e79-f6b195550836]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12226ee-8384-48e8-bb94-dbe675d7846e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-455b8981-77f4-4aaf-a753-0c9245e2cb4c tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47238556-65e7-451b-85d3-e32d7ac7fd9f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260]
Nov 29 14:47:11 user nova-compute[75215]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a78cc68-fd21-492e-ad32-5ed4ff909caa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b717b-ab96-4ce1-b7f1-052ecdabf74b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] <== disconnect_volume: return (363ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:47:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lazy-loading 'flavor' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a9ea18f4-b1a3-4b99-9a8a-e1fb7711cde0 tempest-VolumesAssistedSnapshotsTest-697083157 tempest-VolumesAssistedSnapshotsTest-697083157-project-admin] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c is timed out.
Nov 29 14:47:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully detached device vdb from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the live domain config.
Nov 29 14:47:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMUQiKaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb70a6e-b669-4b9a-b6b9-a7afeef61b49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:47:13 user nova-compute[75215]: No targets found.
Nov 29 14:47:13 user nova-compute[75215]: iSNS:
Nov 29 14:47:13 user nova-compute[75215]: No targets found.
Nov 29 14:47:13 user nova-compute[75215]: STATIC:
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:47:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:47:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:47:13 user nova-compute[75215]: FIRMWARE:
Nov 29 14:47:13 user nova-compute[75215]: No targets found.
Nov 29 14:47:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:47:13 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:47:13 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f765330-7eb1-4baf-9fcc-3a660bec5af9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22217a4-82da-4351-86b4-bcac6eed4b0f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:13 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1'): ({'sdm'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Removing single pathed devices sdm {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[318b7f36-9f53-4db5-bfce-d7ee16891218]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d10ef2-47fd-4d39-a56f-aee25b66c6f4]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Flushing IO for device /dev/sdm {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f26f0-3668-4162-80d2-d2b648d48d42]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.048s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f86b6-edec-4339-b433-d9a5d038bb84]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] SCSI volumes sdm have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc96d2-c628-4614-8867-f30c04248fde]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b136f4-c28f-457f-b18b-5407b4994997]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260]
Nov 29 14:47:14 user nova-compute[75215]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b50cc5-7d57-4962-aa49-bb2da40d0fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf3b9b-fce7-45ed-ab6e-0e8fee3ec698]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] <== disconnect_volume: return (364ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8810d6a8-9583-4778-9a60-9b8f90476c2e tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-58bf2726-e851-48d9-a7a2-6645c0979259" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-58bf2726-e851-48d9-a7a2-6645c0979259" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Attempting to detach device tap58bf2726-e8 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] detach device xml: <interface type="ethernet">
Nov 29 14:47:15 user nova-compute[75215]:   <mac address="fa:16:3e:36:52:8c"/>
Nov 29 14:47:15 user nova-compute[75215]:   <model type="virtio"/>
Nov 29 14:47:15 user nova-compute[75215]:   <mtu size="1442"/>
Nov 29 14:47:15 user nova-compute[75215]:   <target dev="tap58bf2726-e8"/>
Nov 29 14:47:15 user nova-compute[75215]: </interface>
Nov 29 14:47:15 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 29 14:47:15 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 29 14:47:15 user nova-compute[75215]:   <uuid>12ca1bc5-8d9e-473b-953b-4e780e9c809c</uuid>
Nov 29 14:47:15 user nova-compute[75215]:   <metadata>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:15 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:46:35</nova:creationTime>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:15 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:15 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:15 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:15 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:15 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:15 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:15 user nova-compute[75215]:     <nova:port uuid="58bf2726-e851-48d9-a7a2-6645c0979259">
Nov 29 14:47:15 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 29 14:47:15 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:15 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:15 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:15 user nova-compute[75215]:   </metadata>
Nov 29 14:47:15 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 29 14:47:15 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 14:47:15 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 29 14:47:15 user nova-compute[75215]:   <resource>
Nov 29 14:47:15 user nova-compute[75215]:     <partition>/machine</partition>
Nov 29 14:47:15 user nova-compute[75215]:   </resource>
Nov 29 14:47:15 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 29 14:47:15 user nova-compute[75215]:     <system>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='serial'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='uuid'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:15 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 29 14:47:15 user nova-compute[75215]:     </system>
Nov 29 14:47:15 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:15 user nova-compute[75215]:   <os>
Nov 29 14:47:15 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 14:47:15 user nova-compute[75215]:     <boot dev='hd'/>
Nov 29 14:47:15 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 29 14:47:15 user nova-compute[75215]:   </os>
Nov 29 14:47:15 user nova-compute[75215]:   <features>
Nov 29 14:47:15 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:15 user nova-compute[75215]:     <apic/>
Nov 29 14:47:15 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 29 14:47:15 user nova-compute[75215]:   </features>
Nov 29 14:47:15 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 14:47:15 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 29 14:47:15 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 14:47:15 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 29 14:47:15 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 29 14:47:15 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 29 14:47:15 user nova-compute[75215]:   </cpu>
Nov 29 14:47:15 user nova-compute[75215]:   <clock offset='utc'>
Nov 29 14:47:15 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 14:47:15 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 14:47:15 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 29 14:47:15 user nova-compute[75215]:   </clock>
Nov 29 14:47:15 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 29 14:47:15 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 29 14:47:15 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 29 14:47:15 user nova-compute[75215]:   <devices>
Nov 29 14:47:15 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 14:47:15 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 29 14:47:15 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 14:47:15 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk' index='2'/>
Nov 29 14:47:15 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 29 14:47:15 user nova-compute[75215]:         <format type='raw'/>
Nov 29 14:47:15 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c'/>
Nov 29 14:47:15 user nova-compute[75215]:         <backingStore/>
Nov 29 14:47:15 user nova-compute[75215]:       </backingStore>
Nov 29 14:47:15 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </disk>
Nov 29 14:47:15 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 29 14:47:15 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 14:47:15 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config' index='1'/>
Nov 29 14:47:15 user nova-compute[75215]:       <backingStore/>
Nov 29 14:47:15 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 29 14:47:15 user nova-compute[75215]:       <readonly/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </disk>
Nov 29 14:47:15 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='usb'/>
Nov 29 14:47:15 user nova-compute[75215]:     </controller>
Nov 29 14:47:15 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </controller>
Nov 29 14:47:15 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='ide'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 14:47:15 user nova-compute[75215]:     </controller>
Nov 29 14:47:15 user nova-compute[75215]:     <interface type='ethernet'>
Nov 29 14:47:15 user nova-compute[75215]:       <mac address='fa:16:3e:6a:4c:0f'/>
Nov 29 14:47:15 user nova-compute[75215]:       <target dev='tap372566fe-70'/>
Nov 29 14:47:15 user nova-compute[75215]:       <model type='virtio'/>
Nov 29 14:47:15 user nova-compute[75215]:       <mtu size='1442'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='net0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </interface>
Nov 29 14:47:15 user nova-compute[75215]:     <interface type='ethernet'>
Nov 29 14:47:15 user nova-compute[75215]:       <mac address='fa:16:3e:36:52:8c'/>
Nov 29 14:47:15 user nova-compute[75215]:       <target dev='tap58bf2726-e8'/>
Nov 29 14:47:15 user nova-compute[75215]:       <model type='virtio'/>
Nov 29 14:47:15 user nova-compute[75215]:       <mtu size='1442'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='net1'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </interface>
Nov 29 14:47:15 user nova-compute[75215]:     <serial type='pty'>
Nov 29 14:47:15 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:15 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:15 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 29 14:47:15 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 29 14:47:15 user nova-compute[75215]:       </target>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </serial>
Nov 29 14:47:15 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 14:47:15 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:15 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:15 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </console>
Nov 29 14:47:15 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='input0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </input>
Nov 29 14:47:15 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='input1'/>
Nov 29 14:47:15 user nova-compute[75215]:     </input>
Nov 29 14:47:15 user nova-compute[75215]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 29 14:47:15 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </graphics>
Nov 29 14:47:15 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 29 14:47:15 user nova-compute[75215]:     <video>
Nov 29 14:47:15 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='video0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </video>
Nov 29 14:47:15 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 29 14:47:15 user nova-compute[75215]:       <stats period='10'/>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:15 user nova-compute[75215]:     <rng model='virtio'>
Nov 29 14:47:15 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 29 14:47:15 user nova-compute[75215]:       <alias name='rng0'/>
Nov 29 14:47:15 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 14:47:15 user nova-compute[75215]:     </rng>
Nov 29 14:47:15 user nova-compute[75215]:   </devices>
Nov 29 14:47:15 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 14:47:15 user nova-compute[75215]:     <label>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</label>
Nov 29 14:47:15 user nova-compute[75215]:     <imagelabel>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</imagelabel>
Nov 29 14:47:15 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:15 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 14:47:15 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 29 14:47:15 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 14:47:15 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:15 user nova-compute[75215]: </domain>
Nov 29 14:47:15 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 14:47:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully detached device tap58bf2726-e8 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the persistent domain config.
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] (1/8): Attempting to detach device tap58bf2726-e8 with device alias net1 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:47:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] detach device xml: <interface type="ethernet">
Nov 29 14:47:15 user nova-compute[75215]:   <mac address="fa:16:3e:36:52:8c"/>
Nov 29 14:47:15 user nova-compute[75215]:   <model type="virtio"/>
Nov 29 14:47:15 user nova-compute[75215]:   <mtu size="1442"/>
Nov 29 14:47:15 user nova-compute[75215]:   <target dev="tap58bf2726-e8"/>
Nov 29 14:47:15 user nova-compute[75215]: </interface>
Nov 29 14:47:15 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Start waiting for the detach event from libvirt for device tap58bf2726-e8 with device alias net1 for instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-unplugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-unplugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:16 user nova-compute[75215]: WARNING nova.compute.manager [req-0a377d70-ee0d-4e11-b283-e0f8903c985f req-28e11556-1b28-4a21-9cea-86daee6ee0f0 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-unplugged-58bf2726-e851-48d9-a7a2-6645c0979259 for instance with vm_state active and task_state None.
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:47:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Creating image(s)
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Ensure instance console log exists: /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start _get_guest_xml network_info=[{"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '24643217-7fd3-4997-896d-b8fa0e6c5107', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c83d839d-ee08-4c71-b1ce-6b235b33fbbe', 'attached_at': '', 'detached_at': '', 'volume_id': '750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'serial': '750c2cb0-00d2-423b-b2ac-4f80811a58e5'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:47:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 14:47:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lazy-loading 'vcpu_model' on Instance uuid c83d839d-ee08-4c71-b1ce-6b235b33fbbe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:17 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:17 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:47:17 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661ecad-d801-4bc8-b2d7-8deb61e48df0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:47:17 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ebd8c2-137f-466d-89d6-2aa346eec6fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5] added
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08785d9-759d-45e3-9482-d4f53490c1f1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77852b70-44f8-4031-aacc-6fae0e40f777]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTAIUnGD {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTAIUnGD" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6edf7bd-6ee1-48ad-816f-e684187db1b9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTAIUnGD'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae61d7e-ad9a-40f3-be6b-a71fa689295a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4eeeee-4a6a-4369-97cc-0ce588b68e5a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d37bd63-310a-4e04-9d62-e2051e1fd23f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]
Nov 29 14:47:17 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[985cf038-c9c3-4cb2-8e6c-03c5676bc038]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39d6e9-a222-413f-a04d-6c751d206a4b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:47:17 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:47:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8342de73-e358-47ab-ab90-c1178becf430]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:47:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:18 user nova-compute[75215]: WARNING nova.compute.manager [req-48daf904-263c-4bba-8e6e-7323241b2e96 req-d1a439bf-f1e8-41cb-bdb2-a4800a09bea8 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-58bf2726-e851-48d9-a7a2-6645c0979259 for instance with vm_state active and task_state None.
Nov 29 14:47:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26133326163353033', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133326163353033', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1950333669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:47:18 user nova-compute[75215]:   <uuid>c83d839d-ee08-4c71-b1ce-6b235b33fbbe</uuid>
Nov 29 14:47:18 user nova-compute[75215]:   <name>instance-0000000a</name>
Nov 29 14:47:18 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:47:18 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:47:18 user nova-compute[75215]:   <metadata>
Nov 29 14:47:18 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:18 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:47:18 user nova-compute[75215]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1950333669</nova:name>
Nov 29 14:47:18 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:47:17</nova:creationTime>
Nov 29 14:47:18 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:47:18 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:18 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:47:18 user nova-compute[75215]:       <nova:owner>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:user uuid="46ffdcd4720648109006852e64f0d42d">tempest-ServerActionsV293TestJSON-521197919-project-member</nova:user>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:project uuid="932cb09f754945fcae5d455d0e692306">tempest-ServerActionsV293TestJSON-521197919</nova:project>
Nov 29 14:47:18 user nova-compute[75215]:       </nova:owner>
Nov 29 14:47:18 user nova-compute[75215]:       <nova:ports>
Nov 29 14:47:18 user nova-compute[75215]:         <nova:port uuid="e387612b-0d73-403b-b9b1-8c83fe20429f">
Nov 29 14:47:18 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 14:47:18 user nova-compute[75215]:         </nova:port>
Nov 29 14:47:18 user nova-compute[75215]:       </nova:ports>
Nov 29 14:47:18 user nova-compute[75215]:     </nova:instance>
Nov 29 14:47:18 user nova-compute[75215]:   </metadata>
Nov 29 14:47:18 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:47:18 user nova-compute[75215]:     <system>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="serial">c83d839d-ee08-4c71-b1ce-6b235b33fbbe</entry>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="uuid">c83d839d-ee08-4c71-b1ce-6b235b33fbbe</entry>
Nov 29 14:47:18 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:47:18 user nova-compute[75215]:     </system>
Nov 29 14:47:18 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:18 user nova-compute[75215]:   <os>
Nov 29 14:47:18 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:47:18 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:47:18 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:47:18 user nova-compute[75215]:   </os>
Nov 29 14:47:18 user nova-compute[75215]:   <features>
Nov 29 14:47:18 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:18 user nova-compute[75215]:     <apic/>
Nov 29 14:47:18 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:47:18 user nova-compute[75215]:   </features>
Nov 29 14:47:18 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:47:18 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:47:18 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:47:18 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:47:18 user nova-compute[75215]:   </clock>
Nov 29 14:47:18 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:47:18 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:47:18 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:47:18 user nova-compute[75215]:   </cpu>
Nov 29 14:47:18 user nova-compute[75215]:   <devices>
Nov 29 14:47:18 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:47:18 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:47:18 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 14:47:18 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:47:18 user nova-compute[75215]:       <serial>750c2cb0-00d2-423b-b2ac-4f80811a58e5</serial>
Nov 29 14:47:18 user nova-compute[75215]:     </disk>
Nov 29 14:47:18 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:47:18 user nova-compute[75215]:       <mac address="fa:16:3e:53:d8:f7"/>
Nov 29 14:47:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:18 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:47:18 user nova-compute[75215]:       <target dev="tape387612b-0d"/>
Nov 29 14:47:18 user nova-compute[75215]:     </interface>
Nov 29 14:47:18 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:47:18 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe/console.log" append="off"/>
Nov 29 14:47:18 user nova-compute[75215]:     </serial>
Nov 29 14:47:18 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:47:18 user nova-compute[75215]:     <video>
Nov 29 14:47:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:18 user nova-compute[75215]:     </video>
Nov 29 14:47:18 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:47:18 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:47:18 user nova-compute[75215]:     </rng>
Nov 29 14:47:18 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:47:18 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:47:18 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:47:18 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:18 user nova-compute[75215]:   </devices>
Nov 29 14:47:18 user nova-compute[75215]: </domain>
Nov 29 14:47:18 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1950333669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG os_vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30f44d9b-1172-5e19-b747-46fdc678431f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape387612b-0d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape387612b-0d, col_values=(('qos', UUID('52122407-991d-4d47-9d62-cf9f6008a780')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape387612b-0d, col_values=(('external_ids', {'iface-id': 'e387612b-0d73-403b-b9b1-8c83fe20429f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d8:f7', 'vm-uuid': 'c83d839d-ee08-4c71-b1ce-6b235b33fbbe'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:18 user nova-compute[75215]: INFO os_vif [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d')
Nov 29 14:47:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:47:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] No VIF found with MAC fa:16:3e:53:d8:f7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:20 user nova-compute[75215]: WARNING nova.compute.manager [req-89f46bdf-5593-41b7-88f1-8715899aecbf req-c32e0563-ae0e-4912-b896-188cafd764dc service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 14:47:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:47:21 user nova-compute[75215]: INFO nova.compute.claims [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Claim successful on node user
Nov 29 14:47:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:47:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.policy [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b4b269cff8f482cbbd277204b42585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e2fbd35cd4dc89ed674708af95612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:47:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Creating image(s)
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:47:22 user nova-compute[75215]: INFO nova.compute.claims [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Claim successful on node user
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:47:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance spawned successfully.
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:22 user nova-compute[75215]: WARNING nova.compute.manager [req-c98b07d3-9fd4-42f2-a427-340757849f72 req-910fde3e-4ddf-456d-9765-8af7803124f2 service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Successfully created port: a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk 1073741824" returned: 0 in 0.074s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Cannot resize image /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Ensure instance console log exists: /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.429s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75215) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4c59e808-f737-4d3b-8d8a-b1f1b37b1e39 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.policy [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b4b269cff8f482cbbd277204b42585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e2fbd35cd4dc89ed674708af95612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:47:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Creating image(s)
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk 1073741824" returned: 0 in 0.060s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Successfully updated port: a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-changed-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Refreshing instance network info cache due to event network-changed-a984b5ed-5634-4973-97b8-a16a84dd6a18. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Cannot resize image /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Ensure instance console log exists: /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Successfully created port: c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance network_info: |[{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Refreshing network info cache for port a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start _get_guest_xml network_info=[{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:47:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402449986',display_name='tempest-ServerRescueNegativeTestJSON-server-402449986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402449986',id=13,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-dnyei47m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:22Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=a7d3b8e1-c2b3-4175-aef6-db44f969b212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:47:25 user nova-compute[75215]:   <uuid>a7d3b8e1-c2b3-4175-aef6-db44f969b212</uuid>
Nov 29 14:47:25 user nova-compute[75215]:   <name>instance-0000000d</name>
Nov 29 14:47:25 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:47:25 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:47:25 user nova-compute[75215]:   <metadata>
Nov 29 14:47:25 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:25 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402449986</nova:name>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:47:25</nova:creationTime>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:47:25 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:25 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:owner>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:47:25 user nova-compute[75215]:       </nova:owner>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:25 user nova-compute[75215]:       <nova:ports>
Nov 29 14:47:25 user nova-compute[75215]:         <nova:port uuid="a984b5ed-5634-4973-97b8-a16a84dd6a18">
Nov 29 14:47:25 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:47:25 user nova-compute[75215]:         </nova:port>
Nov 29 14:47:25 user nova-compute[75215]:       </nova:ports>
Nov 29 14:47:25 user nova-compute[75215]:     </nova:instance>
Nov 29 14:47:25 user nova-compute[75215]:   </metadata>
Nov 29 14:47:25 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:47:25 user nova-compute[75215]:     <system>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="serial">a7d3b8e1-c2b3-4175-aef6-db44f969b212</entry>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="uuid">a7d3b8e1-c2b3-4175-aef6-db44f969b212</entry>
Nov 29 14:47:25 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:47:25 user nova-compute[75215]:     </system>
Nov 29 14:47:25 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:25 user nova-compute[75215]:   <os>
Nov 29 14:47:25 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:47:25 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:47:25 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:47:25 user nova-compute[75215]:   </os>
Nov 29 14:47:25 user nova-compute[75215]:   <features>
Nov 29 14:47:25 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:25 user nova-compute[75215]:     <apic/>
Nov 29 14:47:25 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:47:25 user nova-compute[75215]:   </features>
Nov 29 14:47:25 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:47:25 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:47:25 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:47:25 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:47:25 user nova-compute[75215]:   </clock>
Nov 29 14:47:25 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:47:25 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:47:25 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:47:25 user nova-compute[75215]:   </cpu>
Nov 29 14:47:25 user nova-compute[75215]:   <devices>
Nov 29 14:47:25 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:47:25 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:47:25 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk"/>
Nov 29 14:47:25 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:47:25 user nova-compute[75215]:     </disk>
Nov 29 14:47:25 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:47:25 user nova-compute[75215]:       <mac address="fa:16:3e:48:3d:b0"/>
Nov 29 14:47:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:25 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:47:25 user nova-compute[75215]:       <target dev="tapa984b5ed-56"/>
Nov 29 14:47:25 user nova-compute[75215]:     </interface>
Nov 29 14:47:25 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:47:25 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/console.log" append="off"/>
Nov 29 14:47:25 user nova-compute[75215]:     </serial>
Nov 29 14:47:25 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:47:25 user nova-compute[75215]:     <video>
Nov 29 14:47:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:25 user nova-compute[75215]:     </video>
Nov 29 14:47:25 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:47:25 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:47:25 user nova-compute[75215]:     </rng>
Nov 29 14:47:25 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:47:25 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:47:25 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:47:25 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:25 user nova-compute[75215]:   </devices>
Nov 29 14:47:25 user nova-compute[75215]: </domain>
Nov 29 14:47:25 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402449986',display_name='tempest-ServerRescueNegativeTestJSON-server-402449986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402449986',id=13,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-dnyei47m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:22Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=a7d3b8e1-c2b3-4175-aef6-db44f969b212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG os_vif [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf2400d3-4f5f-5670-b563-907f59749cb3', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa984b5ed-56, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa984b5ed-56, col_values=(('qos', UUID('8ad361f0-2348-4efd-bc73-86dd7e7628d8')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa984b5ed-56, col_values=(('external_ids', {'iface-id': 'a984b5ed-5634-4973-97b8-a16a84dd6a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:3d:b0', 'vm-uuid': 'a7d3b8e1-c2b3-4175-aef6-db44f969b212'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:25 user nova-compute[75215]: INFO os_vif [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56')
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:48:3d:b0, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updated VIF entry in instance network info cache for port a984b5ed-5634-4973-97b8-a16a84dd6a18. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ffbd1fa3-d388-424c-a26b-1ce423cdfb65 req-94cb4da5-cfc4-4c0f-8e4d-2c65d8f47c8e service nova] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Successfully updated port: c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance network_info: |[{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start _get_guest_xml network_info=[{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:47:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1380020231',display_name='tempest-ServerRescueNegativeTestJSON-server-1380020231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1380020231',id=14,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-9aeuqnxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:24Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=8941f1e0-c109-43be-a997-fedcfd1c8e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:47:26 user nova-compute[75215]:   <uuid>8941f1e0-c109-43be-a997-fedcfd1c8e99</uuid>
Nov 29 14:47:26 user nova-compute[75215]:   <name>instance-0000000e</name>
Nov 29 14:47:26 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:47:26 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:47:26 user nova-compute[75215]:   <metadata>
Nov 29 14:47:26 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:26 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1380020231</nova:name>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:47:26</nova:creationTime>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:47:26 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:26 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:owner>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:47:26 user nova-compute[75215]:       </nova:owner>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:26 user nova-compute[75215]:       <nova:ports>
Nov 29 14:47:26 user nova-compute[75215]:         <nova:port uuid="c6bef3c5-f538-4694-a27a-b633fd02f0f6">
Nov 29 14:47:26 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:47:26 user nova-compute[75215]:         </nova:port>
Nov 29 14:47:26 user nova-compute[75215]:       </nova:ports>
Nov 29 14:47:26 user nova-compute[75215]:     </nova:instance>
Nov 29 14:47:26 user nova-compute[75215]:   </metadata>
Nov 29 14:47:26 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:47:26 user nova-compute[75215]:     <system>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="serial">8941f1e0-c109-43be-a997-fedcfd1c8e99</entry>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="uuid">8941f1e0-c109-43be-a997-fedcfd1c8e99</entry>
Nov 29 14:47:26 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:47:26 user nova-compute[75215]:     </system>
Nov 29 14:47:26 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:26 user nova-compute[75215]:   <os>
Nov 29 14:47:26 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:47:26 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:47:26 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:47:26 user nova-compute[75215]:   </os>
Nov 29 14:47:26 user nova-compute[75215]:   <features>
Nov 29 14:47:26 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:26 user nova-compute[75215]:     <apic/>
Nov 29 14:47:26 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:47:26 user nova-compute[75215]:   </features>
Nov 29 14:47:26 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:47:26 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:47:26 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:47:26 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:47:26 user nova-compute[75215]:   </clock>
Nov 29 14:47:26 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:47:26 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:47:26 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:47:26 user nova-compute[75215]:   </cpu>
Nov 29 14:47:26 user nova-compute[75215]:   <devices>
Nov 29 14:47:26 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:47:26 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:47:26 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk"/>
Nov 29 14:47:26 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:47:26 user nova-compute[75215]:     </disk>
Nov 29 14:47:26 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:47:26 user nova-compute[75215]:       <mac address="fa:16:3e:54:df:ee"/>
Nov 29 14:47:26 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:26 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:47:26 user nova-compute[75215]:       <target dev="tapc6bef3c5-f5"/>
Nov 29 14:47:26 user nova-compute[75215]:     </interface>
Nov 29 14:47:26 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:47:26 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/console.log" append="off"/>
Nov 29 14:47:26 user nova-compute[75215]:     </serial>
Nov 29 14:47:26 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:47:26 user nova-compute[75215]:     <video>
Nov 29 14:47:26 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:26 user nova-compute[75215]:     </video>
Nov 29 14:47:26 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:47:26 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:47:26 user nova-compute[75215]:     </rng>
Nov 29 14:47:26 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:47:26 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:47:26 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:47:26 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:26 user nova-compute[75215]:   </devices>
Nov 29 14:47:26 user nova-compute[75215]: </domain>
Nov 29 14:47:26 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1380020231',display_name='tempest-ServerRescueNegativeTestJSON-server-1380020231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1380020231',id=14,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-9aeuqnxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:24Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=8941f1e0-c109-43be-a997-fedcfd1c8e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG os_vif [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5585bebf-3cb5-5ae1-b8b4-f76b13a14360', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6bef3c5-f5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6bef3c5-f5, col_values=(('qos', UUID('7390b7f4-9efc-455c-bc26-cff17335b943')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6bef3c5-f5, col_values=(('external_ids', {'iface-id': 'c6bef3c5-f538-4694-a27a-b633fd02f0f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:df:ee', 'vm-uuid': '8941f1e0-c109-43be-a997-fedcfd1c8e99'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: INFO os_vif [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5')
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-changed-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Refreshing instance network info cache due to event network-changed-c6bef3c5-f538-4694-a27a-b633fd02f0f6. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] Acquiring lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] Acquired lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Refreshing network info cache for port c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:54:df:ee, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updated VIF entry in instance network info cache for port c6bef3c5-f538-4694-a27a-b633fd02f0f6. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ca7de98-1c0e-41fe-ac7d-03ef3fe2cb8a req-17e98c39-5d3a-47e2-a636-9470bb198338 service nova] Releasing lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:27 user nova-compute[75215]: WARNING nova.compute.manager [req-cb8dac16-267a-44a8-98c3-60bc9d4dfb3e req-990815f9-8d1a-420d-a3d8-43b1efa7d4ec service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state building and task_state spawning.
Nov 29 14:47:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:28 user nova-compute[75215]: WARNING nova.compute.manager [req-3656c1ca-6703-40a3-92e3-e9b00ebd4f9a req-9f857636-d007-4e00-bcd5-ae88ac1111cb service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state building and task_state spawning.
Nov 29 14:47:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:29 user nova-compute[75215]: WARNING nova.compute.manager [req-9f3791f1-27e5-4bff-b455-d7b87c87c794 req-cb41a9d3-10c9-4971-bb65-05163efb6993 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state building and task_state spawning.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:47:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance spawned successfully.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: INFO nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:47:30 user nova-compute[75215]: INFO nova.compute.manager [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Took 8.75 seconds to build instance.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e0427f1-8ac0-44f3-a423-b21660bac75c tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.872s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:47:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance spawned successfully.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:30 user nova-compute[75215]: WARNING nova.compute.manager [req-becf7f5f-62dc-4b7d-a4e0-9dbf13460339 req-b97fe4d4-ebcd-4207-beca-5e70661363de service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state building and task_state spawning.
Nov 29 14:47:30 user nova-compute[75215]: INFO nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 29 14:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:47:31 user nova-compute[75215]: INFO nova.compute.manager [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Took 8.31 seconds to build instance.
Nov 29 14:47:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e30c9f2f-740e-4923-81ba-fd7e2c4b65b8 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.423s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:47:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Waiting for libvirt event about the detach of device tap58bf2726-e8 with device alias net1 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c is timed out.
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 29 14:47:36 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 29 14:47:36 user nova-compute[75215]:   <uuid>12ca1bc5-8d9e-473b-953b-4e780e9c809c</uuid>
Nov 29 14:47:36 user nova-compute[75215]:   <metadata>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:36 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:46:35</nova:creationTime>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:36 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:36 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:36 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:port uuid="58bf2726-e851-48d9-a7a2-6645c0979259">
Nov 29 14:47:36 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 29 14:47:36 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:36 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:36 user nova-compute[75215]:   </metadata>
Nov 29 14:47:36 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 29 14:47:36 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 14:47:36 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 29 14:47:36 user nova-compute[75215]:   <resource>
Nov 29 14:47:36 user nova-compute[75215]:     <partition>/machine</partition>
Nov 29 14:47:36 user nova-compute[75215]:   </resource>
Nov 29 14:47:36 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 29 14:47:36 user nova-compute[75215]:     <system>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='serial'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='uuid'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:36 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 29 14:47:36 user nova-compute[75215]:     </system>
Nov 29 14:47:36 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:36 user nova-compute[75215]:   <os>
Nov 29 14:47:36 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 14:47:36 user nova-compute[75215]:     <boot dev='hd'/>
Nov 29 14:47:36 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 29 14:47:36 user nova-compute[75215]:   </os>
Nov 29 14:47:36 user nova-compute[75215]:   <features>
Nov 29 14:47:36 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:36 user nova-compute[75215]:     <apic/>
Nov 29 14:47:36 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 29 14:47:36 user nova-compute[75215]:   </features>
Nov 29 14:47:36 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 14:47:36 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 29 14:47:36 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 14:47:36 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 29 14:47:36 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 29 14:47:36 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 29 14:47:36 user nova-compute[75215]:   </cpu>
Nov 29 14:47:36 user nova-compute[75215]:   <clock offset='utc'>
Nov 29 14:47:36 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 14:47:36 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 14:47:36 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 29 14:47:36 user nova-compute[75215]:   </clock>
Nov 29 14:47:36 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 29 14:47:36 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 29 14:47:36 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 29 14:47:36 user nova-compute[75215]:   <devices>
Nov 29 14:47:36 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 14:47:36 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 29 14:47:36 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 14:47:36 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk' index='2'/>
Nov 29 14:47:36 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 29 14:47:36 user nova-compute[75215]:         <format type='raw'/>
Nov 29 14:47:36 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c'/>
Nov 29 14:47:36 user nova-compute[75215]:         <backingStore/>
Nov 29 14:47:36 user nova-compute[75215]:       </backingStore>
Nov 29 14:47:36 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </disk>
Nov 29 14:47:36 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 29 14:47:36 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 14:47:36 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config' index='1'/>
Nov 29 14:47:36 user nova-compute[75215]:       <backingStore/>
Nov 29 14:47:36 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 29 14:47:36 user nova-compute[75215]:       <readonly/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </disk>
Nov 29 14:47:36 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='usb'/>
Nov 29 14:47:36 user nova-compute[75215]:     </controller>
Nov 29 14:47:36 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </controller>
Nov 29 14:47:36 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='ide'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 14:47:36 user nova-compute[75215]:     </controller>
Nov 29 14:47:36 user nova-compute[75215]:     <interface type='ethernet'>
Nov 29 14:47:36 user nova-compute[75215]:       <mac address='fa:16:3e:6a:4c:0f'/>
Nov 29 14:47:36 user nova-compute[75215]:       <target dev='tap372566fe-70'/>
Nov 29 14:47:36 user nova-compute[75215]:       <model type='virtio'/>
Nov 29 14:47:36 user nova-compute[75215]:       <mtu size='1442'/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='net0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </interface>
Nov 29 14:47:36 user nova-compute[75215]:     <serial type='pty'>
Nov 29 14:47:36 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:36 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:36 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 29 14:47:36 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 29 14:47:36 user nova-compute[75215]:       </target>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </serial>
Nov 29 14:47:36 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 14:47:36 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:36 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:36 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </console>
Nov 29 14:47:36 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='input0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </input>
Nov 29 14:47:36 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='input1'/>
Nov 29 14:47:36 user nova-compute[75215]:     </input>
Nov 29 14:47:36 user nova-compute[75215]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 29 14:47:36 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </graphics>
Nov 29 14:47:36 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 29 14:47:36 user nova-compute[75215]:     <video>
Nov 29 14:47:36 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='video0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </video>
Nov 29 14:47:36 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 29 14:47:36 user nova-compute[75215]:       <stats period='10'/>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:36 user nova-compute[75215]:     <rng model='virtio'>
Nov 29 14:47:36 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 29 14:47:36 user nova-compute[75215]:       <alias name='rng0'/>
Nov 29 14:47:36 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 14:47:36 user nova-compute[75215]:     </rng>
Nov 29 14:47:36 user nova-compute[75215]:   </devices>
Nov 29 14:47:36 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 14:47:36 user nova-compute[75215]:     <label>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</label>
Nov 29 14:47:36 user nova-compute[75215]:     <imagelabel>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</imagelabel>
Nov 29 14:47:36 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:36 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 14:47:36 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 29 14:47:36 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 14:47:36 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:36 user nova-compute[75215]: </domain>
Nov 29 14:47:36 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 14:47:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully detached device tap58bf2726-e8 from instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c from the live domain config.
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG os_vif [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58bf2726-e8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feb27e0d-8726-4311-aacf-7eaaabe09fb2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:36 user nova-compute[75215]: INFO os_vif [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8')
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:36 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:47:36</nova:creationTime>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:36 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:36 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:36 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:36 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:36 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:36 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:36 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:36 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:47:36 user nova-compute[75215]: INFO nova.compute.claims [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Claim successful on node user
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-deleted-58bf2726-e851-48d9-a7a2-6645c0979259 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:36 user nova-compute[75215]: INFO nova.compute.manager [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Neutron deleted interface 58bf2726-e851-48d9-a7a2-6645c0979259; detaching it from the instance and deleting it from the info cache
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquired lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.720s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.objects.instance [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Lazy-loading 'system_metadata' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:36 user nova-compute[75215]: DEBUG nova.objects.instance [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Lazy-loading 'flavor' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.objects.base [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Object Instance<12ca1bc5-8d9e-473b-953b-4e780e9c809c> lazy-loaded attributes: system_metadata,flavor {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 29 14:47:37 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 29 14:47:37 user nova-compute[75215]:   <uuid>12ca1bc5-8d9e-473b-953b-4e780e9c809c</uuid>
Nov 29 14:47:37 user nova-compute[75215]:   <metadata>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:37 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:47:36</nova:creationTime>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:37 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:37 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:37 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:37 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:37 user nova-compute[75215]:   </metadata>
Nov 29 14:47:37 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 29 14:47:37 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 14:47:37 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 29 14:47:37 user nova-compute[75215]:   <resource>
Nov 29 14:47:37 user nova-compute[75215]:     <partition>/machine</partition>
Nov 29 14:47:37 user nova-compute[75215]:   </resource>
Nov 29 14:47:37 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 29 14:47:37 user nova-compute[75215]:     <system>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='serial'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='uuid'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 29 14:47:37 user nova-compute[75215]:     </system>
Nov 29 14:47:37 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:37 user nova-compute[75215]:   <os>
Nov 29 14:47:37 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 14:47:37 user nova-compute[75215]:     <boot dev='hd'/>
Nov 29 14:47:37 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 29 14:47:37 user nova-compute[75215]:   </os>
Nov 29 14:47:37 user nova-compute[75215]:   <features>
Nov 29 14:47:37 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:37 user nova-compute[75215]:     <apic/>
Nov 29 14:47:37 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 29 14:47:37 user nova-compute[75215]:   </features>
Nov 29 14:47:37 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 14:47:37 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 29 14:47:37 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 29 14:47:37 user nova-compute[75215]:   </cpu>
Nov 29 14:47:37 user nova-compute[75215]:   <clock offset='utc'>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 29 14:47:37 user nova-compute[75215]:   </clock>
Nov 29 14:47:37 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 29 14:47:37 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 29 14:47:37 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 29 14:47:37 user nova-compute[75215]:   <devices>
Nov 29 14:47:37 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 14:47:37 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 29 14:47:37 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 14:47:37 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk' index='2'/>
Nov 29 14:47:37 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 29 14:47:37 user nova-compute[75215]:         <format type='raw'/>
Nov 29 14:47:37 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c'/>
Nov 29 14:47:37 user nova-compute[75215]:         <backingStore/>
Nov 29 14:47:37 user nova-compute[75215]:       </backingStore>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </disk>
Nov 29 14:47:37 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 29 14:47:37 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 14:47:37 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config' index='1'/>
Nov 29 14:47:37 user nova-compute[75215]:       <backingStore/>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 29 14:47:37 user nova-compute[75215]:       <readonly/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </disk>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='usb'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='ide'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <interface type='ethernet'>
Nov 29 14:47:37 user nova-compute[75215]:       <mac address='fa:16:3e:6a:4c:0f'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='tap372566fe-70'/>
Nov 29 14:47:37 user nova-compute[75215]:       <model type='virtio'/>
Nov 29 14:47:37 user nova-compute[75215]:       <mtu size='1442'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='net0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </interface>
Nov 29 14:47:37 user nova-compute[75215]:     <serial type='pty'>
Nov 29 14:47:37 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:37 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 29 14:47:37 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 29 14:47:37 user nova-compute[75215]:       </target>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </serial>
Nov 29 14:47:37 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 14:47:37 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:37 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </console>
Nov 29 14:47:37 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='input0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </input>
Nov 29 14:47:37 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='input1'/>
Nov 29 14:47:37 user nova-compute[75215]:     </input>
Nov 29 14:47:37 user nova-compute[75215]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 29 14:47:37 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </graphics>
Nov 29 14:47:37 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 29 14:47:37 user nova-compute[75215]:     <video>
Nov 29 14:47:37 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='video0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </video>
Nov 29 14:47:37 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 29 14:47:37 user nova-compute[75215]:       <stats period='10'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:37 user nova-compute[75215]:     <rng model='virtio'>
Nov 29 14:47:37 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='rng0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </rng>
Nov 29 14:47:37 user nova-compute[75215]:   </devices>
Nov 29 14:47:37 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 14:47:37 user nova-compute[75215]:     <label>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</label>
Nov 29 14:47:37 user nova-compute[75215]:     <imagelabel>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</imagelabel>
Nov 29 14:47:37 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:37 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 14:47:37 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 29 14:47:37 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 14:47:37 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:37 user nova-compute[75215]: </domain>
Nov 29 14:47:37 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:52:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tap58bf2726-e8"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 29 14:47:37 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 29 14:47:37 user nova-compute[75215]:   <uuid>12ca1bc5-8d9e-473b-953b-4e780e9c809c</uuid>
Nov 29 14:47:37 user nova-compute[75215]:   <metadata>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:37 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:47:36</nova:creationTime>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:37 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:37 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:37 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:37 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:37 user nova-compute[75215]:   </metadata>
Nov 29 14:47:37 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 29 14:47:37 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 14:47:37 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 29 14:47:37 user nova-compute[75215]:   <resource>
Nov 29 14:47:37 user nova-compute[75215]:     <partition>/machine</partition>
Nov 29 14:47:37 user nova-compute[75215]:   </resource>
Nov 29 14:47:37 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 29 14:47:37 user nova-compute[75215]:     <system>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='serial'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='uuid'>12ca1bc5-8d9e-473b-953b-4e780e9c809c</entry>
Nov 29 14:47:37 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 29 14:47:37 user nova-compute[75215]:     </system>
Nov 29 14:47:37 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:37 user nova-compute[75215]:   <os>
Nov 29 14:47:37 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 14:47:37 user nova-compute[75215]:     <boot dev='hd'/>
Nov 29 14:47:37 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 29 14:47:37 user nova-compute[75215]:   </os>
Nov 29 14:47:37 user nova-compute[75215]:   <features>
Nov 29 14:47:37 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:37 user nova-compute[75215]:     <apic/>
Nov 29 14:47:37 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 29 14:47:37 user nova-compute[75215]:   </features>
Nov 29 14:47:37 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 14:47:37 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 29 14:47:37 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 29 14:47:37 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 29 14:47:37 user nova-compute[75215]:   </cpu>
Nov 29 14:47:37 user nova-compute[75215]:   <clock offset='utc'>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 14:47:37 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 29 14:47:37 user nova-compute[75215]:   </clock>
Nov 29 14:47:37 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 29 14:47:37 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 29 14:47:37 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 29 14:47:37 user nova-compute[75215]:   <devices>
Nov 29 14:47:37 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 14:47:37 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 29 14:47:37 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 14:47:37 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk' index='2'/>
Nov 29 14:47:37 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 29 14:47:37 user nova-compute[75215]:         <format type='raw'/>
Nov 29 14:47:37 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c'/>
Nov 29 14:47:37 user nova-compute[75215]:         <backingStore/>
Nov 29 14:47:37 user nova-compute[75215]:       </backingStore>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </disk>
Nov 29 14:47:37 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 29 14:47:37 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 14:47:37 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk.config' index='1'/>
Nov 29 14:47:37 user nova-compute[75215]:       <backingStore/>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 29 14:47:37 user nova-compute[75215]:       <readonly/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </disk>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='usb'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='ide'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 14:47:37 user nova-compute[75215]:     </controller>
Nov 29 14:47:37 user nova-compute[75215]:     <interface type='ethernet'>
Nov 29 14:47:37 user nova-compute[75215]:       <mac address='fa:16:3e:6a:4c:0f'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target dev='tap372566fe-70'/>
Nov 29 14:47:37 user nova-compute[75215]:       <model type='virtio'/>
Nov 29 14:47:37 user nova-compute[75215]:       <mtu size='1442'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='net0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </interface>
Nov 29 14:47:37 user nova-compute[75215]:     <serial type='pty'>
Nov 29 14:47:37 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:37 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 29 14:47:37 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 29 14:47:37 user nova-compute[75215]:       </target>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </serial>
Nov 29 14:47:37 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 14:47:37 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 29 14:47:37 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/console.log' append='off'/>
Nov 29 14:47:37 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='serial0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </console>
Nov 29 14:47:37 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='input0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </input>
Nov 29 14:47:37 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='input1'/>
Nov 29 14:47:37 user nova-compute[75215]:     </input>
Nov 29 14:47:37 user nova-compute[75215]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 29 14:47:37 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </graphics>
Nov 29 14:47:37 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 29 14:47:37 user nova-compute[75215]:     <video>
Nov 29 14:47:37 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='video0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </video>
Nov 29 14:47:37 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 29 14:47:37 user nova-compute[75215]:       <stats period='10'/>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:37 user nova-compute[75215]:     <rng model='virtio'>
Nov 29 14:47:37 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 29 14:47:37 user nova-compute[75215]:       <alias name='rng0'/>
Nov 29 14:47:37 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 14:47:37 user nova-compute[75215]:     </rng>
Nov 29 14:47:37 user nova-compute[75215]:   </devices>
Nov 29 14:47:37 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 14:47:37 user nova-compute[75215]:     <label>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</label>
Nov 29 14:47:37 user nova-compute[75215]:     <imagelabel>libvirt-12ca1bc5-8d9e-473b-953b-4e780e9c809c</imagelabel>
Nov 29 14:47:37 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:37 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 14:47:37 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 29 14:47:37 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 14:47:37 user nova-compute[75215]:   </seclabel>
Nov 29 14:47:37 user nova-compute[75215]: </domain>
Nov 29 14:47:37 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 14:47:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Detaching interface fa:16:3e:36:52:8c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap58bf2726-e8' not found.
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Converting VIF {"id": "58bf2726-e851-48d9-a7a2-6645c0979259", "address": "fa:16:3e:36:52:8c", "network": {"id": "0e4bff66-59c2-49c6-9321-f2b8a56d2842", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1837747335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf2726-e8", "ovs_interfaceid": "58bf2726-e851-48d9-a7a2-6645c0979259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG os_vif [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58bf2726-e8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:47:37 user nova-compute[75215]: INFO os_vif [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=58bf2726-e851-48d9-a7a2-6645c0979259,network=Network(0e4bff66-59c2-49c6-9321-f2b8a56d2842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf2726-e8')
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-110ef999-2a3b-4655-8269-42bf73e46e79 req-3667c81e-2b20-4a59-bf9a-b832f380a244 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:37 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-2127863162</nova:name>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:creationTime>2023-11-29 14:47:37</nova:creationTime>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 29 14:47:37 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:flavor>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:user uuid="919711e94a094e35829f21fe99dda832">tempest-TaggedAttachmentsTest-1908321058-project-member</nova:user>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:project uuid="cddd1c1589154bc090f15ab3dcc1f5c9">tempest-TaggedAttachmentsTest-1908321058</nova:project>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:owner>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:37 user nova-compute[75215]:   <nova:ports>
Nov 29 14:47:37 user nova-compute[75215]:     <nova:port uuid="372566fe-705b-4e33-a003-50c18348fa33">
Nov 29 14:47:37 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:47:37 user nova-compute[75215]:     </nova:port>
Nov 29 14:47:37 user nova-compute[75215]:   </nova:ports>
Nov 29 14:47:37 user nova-compute[75215]: </nova:instance>
Nov 29 14:47:37 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 14:47:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.policy [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd6a80f6b20b43949002e417e3886f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaaf624add446fafb9e263a766959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:47:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Creating image(s)
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "/opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "/opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:37 user nova-compute[75215]: INFO nova.network.neutron [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Port 58bf2726-e851-48d9-a7a2-6645c0979259 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 29 14:47:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [{"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Releasing lock "refresh_cache-12ca1bc5-8d9e-473b-953b-4e780e9c809c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eef01ebb-d00a-4241-bb76-36d65829a17f tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "interface-12ca1bc5-8d9e-473b-953b-4e780e9c809c-58bf2726-e851-48d9-a7a2-6645c0979259" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.101s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Cannot resize image /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Ensure instance console log exists: /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Successfully created port: ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Successfully updated port: ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-changed-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Refreshing instance network info cache due to event network-changed-ed760b66-a402-4eb8-acbd-e91d74b29435. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] Acquiring lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] Acquired lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Refreshing network info cache for port ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:47:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af437e7e-3540-4d80-a242-996743879b0f req-a4091b56-c153-4388-9103-282ee38fa1c3 service nova] Releasing lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquired lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Updating instance_info_cache with network_info: [{"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Releasing lock "refresh_cache-4d412532-27e4-4a63-bea2-818013f2aa30" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance network_info: |[{"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Start _get_guest_xml network_info=[{"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:47:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1326020668',display_name='tempest-VolumesAdminNegativeTest-server-1326020668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1326020668',id=15,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-1rd9t22f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:37Z,user_data=None,user_id='bd6a80f6b20b43949002e417e3886f88',uuid=4d412532-27e4-4a63-bea2-818013f2aa30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d412532-27e4-4a63-bea2-818013f2aa30 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:47:39 user nova-compute[75215]:   <uuid>4d412532-27e4-4a63-bea2-818013f2aa30</uuid>
Nov 29 14:47:39 user nova-compute[75215]:   <name>instance-0000000f</name>
Nov 29 14:47:39 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:47:39 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:47:39 user nova-compute[75215]:   <metadata>
Nov 29 14:47:39 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:47:39 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1326020668</nova:name>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:47:39</nova:creationTime>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:47:39 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:47:39 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:owner>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:user uuid="bd6a80f6b20b43949002e417e3886f88">tempest-VolumesAdminNegativeTest-131765768-project-member</nova:user>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:project uuid="aecaaf624add446fafb9e263a766959e">tempest-VolumesAdminNegativeTest-131765768</nova:project>
Nov 29 14:47:39 user nova-compute[75215]:       </nova:owner>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:47:39 user nova-compute[75215]:       <nova:ports>
Nov 29 14:47:39 user nova-compute[75215]:         <nova:port uuid="ed760b66-a402-4eb8-acbd-e91d74b29435">
Nov 29 14:47:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 14:47:39 user nova-compute[75215]:         </nova:port>
Nov 29 14:47:39 user nova-compute[75215]:       </nova:ports>
Nov 29 14:47:39 user nova-compute[75215]:     </nova:instance>
Nov 29 14:47:39 user nova-compute[75215]:   </metadata>
Nov 29 14:47:39 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:47:39 user nova-compute[75215]:     <system>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="serial">4d412532-27e4-4a63-bea2-818013f2aa30</entry>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="uuid">4d412532-27e4-4a63-bea2-818013f2aa30</entry>
Nov 29 14:47:39 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:47:39 user nova-compute[75215]:     </system>
Nov 29 14:47:39 user nova-compute[75215]:   </sysinfo>
Nov 29 14:47:39 user nova-compute[75215]:   <os>
Nov 29 14:47:39 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:47:39 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:47:39 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:47:39 user nova-compute[75215]:   </os>
Nov 29 14:47:39 user nova-compute[75215]:   <features>
Nov 29 14:47:39 user nova-compute[75215]:     <acpi/>
Nov 29 14:47:39 user nova-compute[75215]:     <apic/>
Nov 29 14:47:39 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:47:39 user nova-compute[75215]:   </features>
Nov 29 14:47:39 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:47:39 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:47:39 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:47:39 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:47:39 user nova-compute[75215]:   </clock>
Nov 29 14:47:39 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:47:39 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:47:39 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:47:39 user nova-compute[75215]:   </cpu>
Nov 29 14:47:39 user nova-compute[75215]:   <devices>
Nov 29 14:47:39 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:47:39 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:47:39 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk"/>
Nov 29 14:47:39 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:47:39 user nova-compute[75215]:     </disk>
Nov 29 14:47:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:47:39 user nova-compute[75215]:       <mac address="fa:16:3e:dd:28:11"/>
Nov 29 14:47:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:47:39 user nova-compute[75215]:       <target dev="taped760b66-a4"/>
Nov 29 14:47:39 user nova-compute[75215]:     </interface>
Nov 29 14:47:39 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:47:39 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/console.log" append="off"/>
Nov 29 14:47:39 user nova-compute[75215]:     </serial>
Nov 29 14:47:39 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:47:39 user nova-compute[75215]:     <video>
Nov 29 14:47:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:47:39 user nova-compute[75215]:     </video>
Nov 29 14:47:39 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:47:39 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:47:39 user nova-compute[75215]:     </rng>
Nov 29 14:47:39 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:47:39 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:47:39 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:47:39 user nova-compute[75215]:     </memballoon>
Nov 29 14:47:39 user nova-compute[75215]:   </devices>
Nov 29 14:47:39 user nova-compute[75215]: </domain>
Nov 29 14:47:39 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1326020668',display_name='tempest-VolumesAdminNegativeTest-server-1326020668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1326020668',id=15,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-1rd9t22f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:37Z,user_data=None,user_id='bd6a80f6b20b43949002e417e3886f88',uuid=4d412532-27e4-4a63-bea2-818013f2aa30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG os_vif [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84d05f2f-eb13-5313-b235-c807d648b415', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped760b66-a4, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped760b66-a4, col_values=(('qos', UUID('f082af8e-19c6-48ab-ac24-7562f1b1ceee')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped760b66-a4, col_values=(('external_ids', {'iface-id': 'ed760b66-a402-4eb8-acbd-e91d74b29435', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:28:11', 'vm-uuid': '4d412532-27e4-4a63-bea2-818013f2aa30'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:39 user nova-compute[75215]: INFO os_vif [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4')
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:47:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] No VIF found with MAC fa:16:3e:dd:28:11, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] No waiting events found dispatching network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:41 user nova-compute[75215]: WARNING nova.compute.manager [req-63777789-f1e1-4d79-8e79-35a73c9d265d req-2dd7f8b9-9fef-4ab5-b7c1-c39577827891 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received unexpected event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 for instance with vm_state building and task_state spawning.
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:47:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance spawned successfully.
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] No waiting events found dispatching network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:43 user nova-compute[75215]: WARNING nova.compute.manager [req-26e74ccd-5ff7-46c6-915b-edb683928fcb req-9619b0f0-270f-4469-881c-a116e7aa0725 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received unexpected event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 for instance with vm_state building and task_state spawning.
Nov 29 14:47:43 user nova-compute[75215]: INFO nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 29 14:47:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:47:43 user nova-compute[75215]: INFO nova.compute.manager [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Took 7.66 seconds to build instance.
Nov 29 14:47:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7b7e121f-0ff2-4a6d-9d15-6fe5ec6e68b7 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.835s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:45 user nova-compute[75215]: INFO nova.compute.manager [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Terminating instance
Nov 29 14:47:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-unplugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] No waiting events found dispatching network-vif-unplugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-0490a9fb-f2bd-4946-b9fb-1f3204748784 req-c064b321-ea91-4e96-9fb7-64aaf190c35e service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-unplugged-de4a691a-0940-4b8c-a811-b19c29eda308 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.compute.manager [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] instance snapshotting
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Beginning live snapshot process
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Instance destroyed successfully.
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lazy-loading 'resources' on Instance uuid 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-844252927',display_name='tempest-VolumesAssistedSnapshotsTest-server-844252927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-844252927',id=9,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjeCBsaItpc0cgChtuKgRqEmCSB6mqSGuu7s2rDmfjuISmCmxosSSzrqrrJ0SXCW6vdN0EKAk3lDjsBclZfk+QTBsXaUtDTdu/Fikqco0v3Momeg4DxCfsiXRuVjVhi3Q==',key_name='tempest-keypair-354500459',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e74b5033c0c4446b49a041e3302b44b',ramdisk_id='',reservation_id='r-mt5nuwfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-867689237',owner_user_name='tempest-VolumesAssistedSnapshotsTest-867689237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8504ddc20f4a4221a45354e756a4f125',uuid=2fbaf950-0f62-4db3-9fcc-7cf6a388fa63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converting VIF {"id": "de4a691a-0940-4b8c-a811-b19c29eda308", "address": "fa:16:3e:f2:15:ec", "network": {"id": "37bd0581-cc4b-42f6-9fd3-7dfb4462f341", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-688801980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e74b5033c0c4446b49a041e3302b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a691a-09", "ovs_interfaceid": "de4a691a-0940-4b8c-a811-b19c29eda308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG os_vif [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4a691a-09, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d16a66df-6634-42ee-817e-9218a368dd56) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:46 user nova-compute[75215]: INFO os_vif [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:15:ec,bridge_name='br-int',has_traffic_filtering=True,id=de4a691a-0940-4b8c-a811-b19c29eda308,network=Network(37bd0581-cc4b-42f6-9fd3-7dfb4462f341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a691a-09')
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Deleting instance files /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63_del
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Deletion of /opt/stack/data/nova/instances/2fbaf950-0f62-4db3-9fcc-7cf6a388fa63_del complete
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:46 user nova-compute[75215]: INFO nova.compute.manager [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.406s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4.delta 1073741824" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-1427b657-7dae-4b6f-8fed-1fa40ba7fc28 req-17471bd1-4053-4657-b9cd-7da99d5b5ae8 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-deleted-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:48 user nova-compute[75215]: INFO nova.compute.manager [req-1427b657-7dae-4b6f-8fed-1fa40ba7fc28 req-17471bd1-4053-4657-b9cd-7da99d5b5ae8 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Neutron deleted interface de4a691a-0940-4b8c-a811-b19c29eda308; detaching it from the instance and deleting it from the info cache
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-1427b657-7dae-4b6f-8fed-1fa40ba7fc28 req-17471bd1-4053-4657-b9cd-7da99d5b5ae8 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:48 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Took 1.44 seconds to deallocate network for instance.
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-1427b657-7dae-4b6f-8fed-1fa40ba7fc28 req-17471bd1-4053-4657-b9cd-7da99d5b5ae8 service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Detach interface failed, port_id=de4a691a-0940-4b8c-a811-b19c29eda308, reason: Instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] Acquiring lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] No waiting events found dispatching network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:48 user nova-compute[75215]: WARNING nova.compute.manager [req-28c755c9-8e36-4c6c-8095-e8a990ff5e16 req-ca7294cc-5949-423b-a773-3787382f293f service nova] [instance: 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63] Received unexpected event network-vif-plugged-de4a691a-0940-4b8c-a811-b19c29eda308 for instance with vm_state deleted and task_state None.
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:47:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 14:47:48 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Deleted allocations for instance 2fbaf950-0f62-4db3-9fcc-7cf6a388fa63
Nov 29 14:47:48 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4.delta /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6b8d3861-ba5d-4243-b082-a87584c4fb81 tempest-VolumesAssistedSnapshotsTest-867689237 tempest-VolumesAssistedSnapshotsTest-867689237-project-member] Lock "2fbaf950-0f62-4db3-9fcc-7cf6a388fa63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4.delta /opt/stack/data/nova/instances/snapshots/tmpzfd7l4pi/b75e2331102745298fb2265d826fc5c4" returned: 0 in 0.385s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Snapshot extracted, beginning image upload
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-changed-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing instance network info cache due to event network-changed-8b7fb46f-2367-452e-8738-845846741434. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] Acquiring lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] Acquired lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Refreshing network info cache for port 8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-changed-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing instance network info cache due to event network-changed-66dc7e57-bef0-4007-a45a-80aeaa7b0e70. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] Acquiring lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] Acquired lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:47:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Refreshing network info cache for port 66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating instance_info_cache with network_info: [{"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-003296b4-4960-4814-b48c-ddd133e060a8" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:47:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Snapshot image upload complete
Nov 29 14:47:52 user nova-compute[75215]: INFO nova.compute.manager [None req-77472538-5c53-4934-9bd1-2a6358ef6585 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Took 6.17 seconds to snapshot the instance on the hypervisor.
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updated VIF entry in instance network info cache for port 66dc7e57-bef0-4007-a45a-80aeaa7b0e70. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4834f694-d138-41c7-8786-541ab9edd270 req-518c3216-e911-4d44-9b65-f44372acdd4e service nova] Releasing lock "refresh_cache-1567bac5-1f03-4c69-8951-f4d5c097d81c" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updated VIF entry in instance network info cache for port 8b7fb46f-2367-452e-8738-845846741434. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b7635f5-a0ba-4357-b0ae-e89dce38fc85 req-9f5d42e8-dfb0-4ec7-b840-5ec981fe4fe6 service nova] Releasing lock "refresh_cache-937930ff-fe15-4b44-a8fc-7a74bd86f927" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:54 user nova-compute[75215]: INFO nova.compute.manager [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Terminating instance
Nov 29 14:47:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: INFO nova.compute.manager [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Terminating instance
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cade174-a4b3-4f2e-965d-5adb457677ee req-11f60a98-0ef0-42f3-9bac-6ad412f56cf8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-916215f6-9a78-4c2e-ad2c-af2b89f623f4 req-11bca18a-59a8-41c3-b54a-18d22ef20380 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-8b7fb46f-2367-452e-8738-845846741434 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:47:55 user nova-compute[75215]: INFO nova.compute.claims [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Claim successful on node user
Nov 29 14:47:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-7788ffbf-c3be-4079-9f35-7384c8a3977f req-dee342ad-92c6-43c4-9235-0f39c9c199ef service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-31315a06-22c4-487d-888e-47d789df66b8 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Instance destroyed successfully.
Nov 29 14:47:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lazy-loading 'resources' on Instance uuid 1567bac5-1f03-4c69-8951-f4d5c097d81c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66dc7e57-be, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.348s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'flavor' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e876658c-757b-48bf-b5ef-886ea8d2cdda) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.169s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:47:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Instance destroyed successfully.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lazy-loading 'resources' on Instance uuid 937930ff-fe15-4b44-a8fc-7a74bd86f927 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-3c846958-280b-4134-bc9f-1d71a8895213 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-3c846958-280b-4134-bc9f-1d71a8895213 for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-53bfdf32-80f7-4746-9e59-e6eb057ef65c req-63151a6a-5d7e-463c-83d2-1a8098fb29b8 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-a7bafecb-a540-4ab4-a379-85898f0b67e8 for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.policy [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '305d74ce2c5d45808e89090d17e4271c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1daf66a83db841908f3aea8c06feed26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-8b7fb46f-2367-452e-8738-845846741434 for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-e38d58a4-34a4-4cc7-88a1-2c25c0f97045 for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-184b5674-2b78-43fb-8969-f9002a50db6c for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:57 user nova-compute[75215]: WARNING nova.compute.manager [req-b70362c2-4319-428e-b333-21e7db643c14 req-dd33beea-5162-40af-baec-da239ab5667f service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-184b5674-2b78-43fb-8969-f9002a50db6c for instance with vm_state active and task_state deleting.
Nov 29 14:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:58 user nova-compute[75215]: WARNING nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-31315a06-22c4-487d-888e-47d789df66b8 for instance with vm_state active and task_state deleting.
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:58 user nova-compute[75215]: WARNING nova.compute.manager [req-d17433cc-7e05-4bb0-9fc0-8faae6a6be90 req-a61b479c-1f34-47f0-8468-3f6771097142 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-67741ca5-e257-4b30-927f-cd4cf2c74b12 for instance with vm_state active and task_state deleting.
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: INFO nova.compute.manager [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attaching volume ce68cdba-83fd-46cd-8f87-58e082a648db to /dev/vdb
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:47:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Creating image(s)
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "/opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "/opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "/opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b7fb46f-23, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:58 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=66dc7e57-bef0-4007-a45a-80aeaa7b0e70,network=Network(f1a7e538-d998-49f6-b85c-0b7560ac2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66dc7e57-be')
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:47:58 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7288MB free_disk=25.136550903320312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Successfully created port: ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f19b2-4c39-484c-bb0a-5b4c6d03884a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aa54c26-b6, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: INFO nova.compute.manager [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Unshelving
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851c2e4-445d-47c3-a3e1-1951c0764359]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[955dbc14-7fb4-4b8f-ac59-629d615754ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5accb-d9e4-4ee3-9851-e5441b6d23a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 937930ff-fe15-4b44-a8fc-7a74bd86f927 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 4d412532-27e4-4a63-bea2-818013f2aa30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 706eda24-7f1a-4a11-836f-81777fbee1a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: WARNING nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee for instance with vm_state active and task_state deleting.
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-4c8493be-f778-44b4-9d50-b7963f0b9dda for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: WARNING nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-4c8493be-f778-44b4-9d50-b7963f0b9dda for instance with vm_state active and task_state deleting.
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-1cb05572-fee2-4539-8065-3819fee3b342 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:47:59 user nova-compute[75215]: WARNING nova.compute.manager [req-41ec9187-46b1-4234-8746-9fb85e60b5fe req-0d86d2e9-4e21-494c-9fd7-5a4390a2ff41 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-1cb05572-fee2-4539-8065-3819fee3b342 for instance with vm_state active and task_state deleting.
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.part --force-share --output=json" returned: 0 in 0.240s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:47:59 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2319440-eeb6-4379-9040-f05c34d359a0]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.virt.images [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] 4809ab4e-27cb-4437-94da-a4f4634a6b76 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.part /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: INFO nova.virt.block_device [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Booting with volume 071b175e-acc2-4f2e-ba01-4182dbd5126b at /dev/vdc
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] <== get_connector_properties: return (263ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating existing volume attachment record: bfb92b27-26a1-49fd-a8f0-59d0fb3ff400 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d009c46e-ba37-4972-99a4-96cf7309b719) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84be36-8c2a-48b1-afed-3c49a4cc90d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df40de9-8884-4d93-a287-a5e8af57c6ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:47:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.part /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.converted" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec0143-f8b3-4000-bc31-62fd427b2e00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f30cfd97-13b4-4cda-aa0b-a4ce510aae4f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:e2,bridge_name='br-int',has_traffic_filtering=True,id=8b7fb46f-2367-452e-8738-845846741434,network=Network(75c305f1-7031-4c11-a1a4-38333c6f677a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7fb46f-23')
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf6c00-49f8-454a-9933-53d5d9e63b1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:48:00 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61b2a7-3a9c-4abc-915e-d52b13c9b4f1]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_brick.utils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] <== get_connector_properties: return (275ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating existing volume attachment record: 7511325b-bd93-4cce-90db-439314b0e0cc {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-unplugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-unplugged-10f513d4-5565-4486-b7a3-c02eaedc9434 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Acquiring lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] No waiting events found dispatching network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:00 user nova-compute[75215]: WARNING nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received unexpected event network-vif-plugged-10f513d4-5565-4486-b7a3-c02eaedc9434 for instance with vm_state active and task_state deleting.
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-unplugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-unplugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Acquiring lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] No waiting events found dispatching network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:00 user nova-compute[75215]: WARNING nova.compute.manager [req-88a4e1e6-3dbe-4665-aa5b-4173bd7ea088 req-59a170da-74f2-4d73-849a-bbaccd122bb0 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received unexpected event network-vif-plugged-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f for instance with vm_state active and task_state deleting.
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape38d58a4-34, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9aa54c26-b6')
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.803s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Successfully updated port: ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c846958-28, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquired lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing instance network info cache due to event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] Acquiring lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b271a2a0-91a8-4f65-97af-ccbedbfe2925) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0659ec6-e4c6-4b32-83ef-86056fea7c8f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e9:48,bridge_name='br-int',has_traffic_filtering=True,id=e38d58a4-34a4-4cc7-88a1-2c25c0f97045,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape38d58a4-34')
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8,backing_fmt=raw /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.204s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8,backing_fmt=raw /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk 1073741824" returned: 0 in 0.068s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "334b1b0f42a57c559d9cf03b27123fe149b06fb8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31315a06-22, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:19:09,bridge_name='br-int',has_traffic_filtering=True,id=3c846958-280b-4134-bc9f-1d71a8895213,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c846958-28')
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "address": "fa:16:3e:46:0b:52", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bafecb-a5", "ovs_interfaceid": "a7bafecb-a540-4ab4-a379-85898f0b67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7bafecb-a5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating instance_info_cache with network_info: [{"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Ensure instance console log exists: /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Releasing lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance network_info: |[{"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] Acquired lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing network info cache for port ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Start _get_guest_xml network_info=[{"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3c8d276ece48ea7cdc9197aa3c0f09d6',container_format='bare',created_at=2023-11-29T14:47:46Z,direct_url=<?>,disk_format='qcow2',id=4809ab4e-27cb-4437-94da-a4f4634a6b76,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1393913325',owner='1daf66a83db841908f3aea8c06feed26',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T14:47:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': '4809ab4e-27cb-4437-94da-a4f4634a6b76'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:48:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74def208-c880-40a3-837a-fb3562b841ab) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3c8d276ece48ea7cdc9197aa3c0f09d6',container_format='bare',created_at=2023-11-29T14:47:46Z,direct_url=<?>,disk_format='qcow2',id=4809ab4e-27cb-4437-94da-a4f4634a6b76,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1393913325',owner='1daf66a83db841908f3aea8c06feed26',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T14:47:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-668738058',display_name='tempest-TestStampPattern-server-668738058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-668738058',id=16,image_ref='4809ab4e-27cb-4437-94da-a4f4634a6b76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-d8v2es99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3f429494-a371-4b16-8659-bd56c4e7a775',image_min_disk='1',image_min_ram='0',image_owner_id='1daf66a83db841908f3aea8c06feed26',image_owner_project_name='tempest-TestStampPattern-678480478',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678480478-project-member',image_user_id='305d74ce2c5d45808e89090d17e4271c',network_allocated='True',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:58Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=706eda24-7f1a-4a11-836f-81777fbee1a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'pci_devices' on Instance uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:48:00 user nova-compute[75215]:   <uuid>706eda24-7f1a-4a11-836f-81777fbee1a1</uuid>
Nov 29 14:48:00 user nova-compute[75215]:   <name>instance-00000010</name>
Nov 29 14:48:00 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:48:00 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:48:00 user nova-compute[75215]:   <metadata>
Nov 29 14:48:00 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:48:00 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:name>tempest-TestStampPattern-server-668738058</nova:name>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:48:00</nova:creationTime>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:48:00 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:48:00 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:owner>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:user uuid="305d74ce2c5d45808e89090d17e4271c">tempest-TestStampPattern-678480478-project-member</nova:user>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:project uuid="1daf66a83db841908f3aea8c06feed26">tempest-TestStampPattern-678480478</nova:project>
Nov 29 14:48:00 user nova-compute[75215]:       </nova:owner>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:root type="image" uuid="4809ab4e-27cb-4437-94da-a4f4634a6b76"/>
Nov 29 14:48:00 user nova-compute[75215]:       <nova:ports>
Nov 29 14:48:00 user nova-compute[75215]:         <nova:port uuid="ce19f3e2-1caa-4a09-8027-3947a5a0209d">
Nov 29 14:48:00 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 14:48:00 user nova-compute[75215]:         </nova:port>
Nov 29 14:48:00 user nova-compute[75215]:       </nova:ports>
Nov 29 14:48:00 user nova-compute[75215]:     </nova:instance>
Nov 29 14:48:00 user nova-compute[75215]:   </metadata>
Nov 29 14:48:00 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:48:00 user nova-compute[75215]:     <system>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="serial">706eda24-7f1a-4a11-836f-81777fbee1a1</entry>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="uuid">706eda24-7f1a-4a11-836f-81777fbee1a1</entry>
Nov 29 14:48:00 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:48:00 user nova-compute[75215]:     </system>
Nov 29 14:48:00 user nova-compute[75215]:   </sysinfo>
Nov 29 14:48:00 user nova-compute[75215]:   <os>
Nov 29 14:48:00 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:48:00 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:48:00 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:48:00 user nova-compute[75215]:   </os>
Nov 29 14:48:00 user nova-compute[75215]:   <features>
Nov 29 14:48:00 user nova-compute[75215]:     <acpi/>
Nov 29 14:48:00 user nova-compute[75215]:     <apic/>
Nov 29 14:48:00 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:48:00 user nova-compute[75215]:   </features>
Nov 29 14:48:00 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:48:00 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:48:00 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:48:00 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:48:00 user nova-compute[75215]:   </clock>
Nov 29 14:48:00 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:48:00 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:48:00 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:48:00 user nova-compute[75215]:   </cpu>
Nov 29 14:48:00 user nova-compute[75215]:   <devices>
Nov 29 14:48:00 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:48:00 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:48:00 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk"/>
Nov 29 14:48:00 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:48:00 user nova-compute[75215]:     </disk>
Nov 29 14:48:00 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:48:00 user nova-compute[75215]:       <mac address="fa:16:3e:38:4a:db"/>
Nov 29 14:48:00 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:00 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:48:00 user nova-compute[75215]:       <target dev="tapce19f3e2-1c"/>
Nov 29 14:48:00 user nova-compute[75215]:     </interface>
Nov 29 14:48:00 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:48:00 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/console.log" append="off"/>
Nov 29 14:48:00 user nova-compute[75215]:     </serial>
Nov 29 14:48:00 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:48:00 user nova-compute[75215]:     <video>
Nov 29 14:48:00 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:00 user nova-compute[75215]:     </video>
Nov 29 14:48:00 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:48:00 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:48:00 user nova-compute[75215]:     </rng>
Nov 29 14:48:00 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:48:00 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:48:00 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:48:00 user nova-compute[75215]:     </memballoon>
Nov 29 14:48:00 user nova-compute[75215]:   </devices>
Nov 29 14:48:00 user nova-compute[75215]: </domain>
Nov 29 14:48:00 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-668738058',display_name='tempest-TestStampPattern-server-668738058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-668738058',id=16,image_ref='4809ab4e-27cb-4437-94da-a4f4634a6b76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-d8v2es99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3f429494-a371-4b16-8659-bd56c4e7a775',image_min_disk='1',image_min_ram='0',image_owner_id='1daf66a83db841908f3aea8c06feed26',image_owner_project_name='tempest-TestStampPattern-678480478',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678480478-project-member',image_user_id='305d74ce2c5d45808e89090d17e4271c',network_allocated='True',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:58Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=706eda24-7f1a-4a11-836f-81777fbee1a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e90d5da6-c2b2-4e9b-89dc-3314daf6eaf1) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:00 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:33:d8,bridge_name='br-int',has_traffic_filtering=True,id=31315a06-22c4-487d-888e-47d789df66b8,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31315a06-22')
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "address": "fa:16:3e:88:06:7b", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28bc5a8f-f5", "ovs_interfaceid": "28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:00 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28bc5a8f-f5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=a7bafecb-a540-4ab4-a379-85898f0b67e8,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bafecb-a5')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17da3e9e-efd0-5bbb-971f-35c67e71d118', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5df089f-1855-41ce-a085-c45e9a4ec48d) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67741ca5-e2, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:06:7b,bridge_name='br-int',has_traffic_filtering=True,id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28bc5a8f-f5')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce19f3e2-1c, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce19f3e2-1c, col_values=(('qos', UUID('09e26605-fdfb-43db-8ac4-84fcebc668d0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce19f3e2-1c, col_values=(('external_ids', {'iface-id': 'ce19f3e2-1caa-4a09-8027-3947a5a0209d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:4a:db', 'vm-uuid': '706eda24-7f1a-4a11-836f-81777fbee1a1'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updated VIF entry in instance network info cache for port ce19f3e2-1caa-4a09-8027-3947a5a0209d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating instance_info_cache with network_info: [{"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ee77906-f448-4040-ab9b-6ba003330ec4 req-8f6d8079-45cf-4c9c-a46c-cad7bd934587 service nova] Releasing lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39df233c-b114-4b05-bc42-ba3102a84e14) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap184b5674-2b, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c5:03,bridge_name='br-int',has_traffic_filtering=True,id=67741ca5-e257-4b30-927f-cd4cf2c74b12,network=Network(d9938bbf-c8e3-48be-8873-c238d855049b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67741ca5-e2')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No VIF found with MAC fa:16:3e:38:4a:db, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10f513d4-55, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cca06f72-aa99-42c6-8955-ac7ada6d656c) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd96889f-e4fb-4284-9066-84aebf311ff9) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=184b5674-2b78-43fb-8969-f9002a50db6c,network=Network(b8a092a0-1da1-402d-b02d-59470d40d6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184b5674-2b')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd68b80a-ea, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:fe,bridge_name='br-int',has_traffic_filtering=True,id=10f513d4-5565-4486-b7a3-c02eaedc9434,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f513d4-55')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1225976930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1225976930',id=12,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LsF0jkBXBxbJShBLbTbzYCFgoHsKaXwciMVHOMrMBIXTpic3dPA6ughf3y0qKOe9v/8g88q6k77IhiLI1/MAO9ebL0LmEliBzSJxryHWjOQ9LyE+LWqkVH4buNXZUwQ==',key_name='tempest-keypair-1021111213',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dccd2d1a43f4aabbfce4440f4b1b04d',ramdisk_id='',reservation_id='r-znd2tqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2130810757',owner_user_name='tempest-TaggedBootDevicesTest-2130810757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f922ff36e72437aaf3e4b9a65189144',uuid=1567bac5-1f03-4c69-8951-f4d5c097d81c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converting VIF {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c8493be-f7, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b9a72b-6dbc-432d-9d05-a5ccbef3c6cb) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4529e46a-3f6b-454b-9f9a-b92a22b981e4) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd68b80a-ea')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1134667568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1134667568',id=11,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ5Gy+3B1JRWHtdjVtsDdpyC8m+Zo3JKSYBa5a/e1fkyHouca4Mpn4fO7cQtjaljqF/r4s4q9s2LlvI4NQ/I5WxZ9Rxmex7rU5ykV4FadNlEJFIscZu6NtYVTjZ9EodQ==',key_name='tempest-keypair-883462604',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3d0f0a4beb48eb8eb4d3380268a11d',ramdisk_id='',reservation_id='r-4e9txm3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1966625572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1966625572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a2deadfb65345c28f41e5488c438309',uuid=937930ff-fe15-4b44-a8fc-7a74bd86f927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converting VIF {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb05572-fe, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:50:b1,bridge_name='br-int',has_traffic_filtering=True,id=4c8493be-f778-44b4-9d50-b7963f0b9dda,network=Network(6c8e2701-c39d-4afb-9133-16113045f934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8493be-f7')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYajquzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf04edb7-7f6f-461e-b658-908225971168) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:01 user nova-compute[75215]: INFO os_vif [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d8:fa,bridge_name='br-int',has_traffic_filtering=True,id=1cb05572-fee2-4539-8065-3819fee3b342,network=Network(ba8221cc-9c94-439a-be11-f4b32f0f6061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb05572-fe')
Nov 29 14:48:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtamfZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[376db044-4e44-4513-954b-43ac5bd43562]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:01 user nova-compute[75215]: No targets found.
Nov 29 14:48:01 user nova-compute[75215]: iSNS:
Nov 29 14:48:01 user nova-compute[75215]: No targets found.
Nov 29 14:48:01 user nova-compute[75215]: STATIC:
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:01 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:01 user nova-compute[75215]: No targets found.
Nov 29 14:48:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:01 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:01 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f566d3e-e6db-4c8a-ae9f-79c0b1f606aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a71b83-8fdb-4063-864f-9017c2749b21]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:01 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac58ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c665d73-9467-4a9b-b8e0-dd863dbe6bc4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa67ffe-e75d-453a-8ce0-307afd38a267]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3bb26-b3f6-4049-ad81-28748e1e2363]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d4fcf-c89e-4af2-b566-8c00435bcad0]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42392c2-65b5-4a54-871d-c4c42881eb97]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434b203-311e-4990-a1a5-f2a32664169a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260]
Nov 29 14:48:02 user nova-compute[75215]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebfbf3-e657-4877-b2b6-958eff0b57b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdbf6ef-7d7b-4a63-a2d7-84a9b1647a2d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== disconnect_volume: return (366ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.340s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEwZfcGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5dcaf7-4932-49b1-9171-9a37ce3f2af9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: iSNS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: STATIC:
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:02 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ff6d4-2830-4b8a-8509-34a6b6172467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[58abfbe8-9496-46c0-9fb3-d976cbbccb01]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac58ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3d1f4-1ae9-4d8b-bd23-3690d9b890d4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842b025-5d11-4bef-b07b-74b7f81ed469]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1103ca-693b-4996-8ea1-af9d5aab27ef]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41487b36-9c18-43e1-99c1-1b294956bf39]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0132d5-3486-4591-8cdb-92ffad9d6ee6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7eb09-24f8-4678-9d47-ee66d083fdb8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260]
Nov 29 14:48:02 user nova-compute[75215]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4659d389-95f1-4e8d-9244-368536f1347f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91a867-7a82-46ba-9d3e-fbcdc8277f15]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== disconnect_volume: return (680ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.337s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCkmNJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe70d48-6d71-4021-90cd-d32e2b5c865e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: iSNS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: STATIC:
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:02 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55df54-2fde-4dd3-b4a3-a8911d65bfd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed512c-073e-4b6f-8fac-9b945e6a4c40]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac589cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc84f3f-cdc6-4b25-b3cf-b2c87b2843c9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0de0f0-edb4-4e3a-8114-aebe7a7a0865]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e82f5-579f-42d7-a579-0ca827a06031]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac15565b-4747-413b-8ac0-18d3dcd57844]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e913c-cf54-4b73-8482-ed3f2a90314d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8543743c-4a6b-4c1e-b488-f1966018316a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260]
Nov 29 14:48:02 user nova-compute[75215]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f87a8d8-4688-434d-9b13-b107bd6b6f3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c2db6-0b6c-42d7-8fb7-9c3ddcbf1af7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== disconnect_volume: return (667ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOUGAdvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c3f7f-fce4-44f7-972e-a90f0e41c785]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: iSNS:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]: STATIC:
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:02 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:02 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:02 user nova-compute[75215]: No targets found.
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:02 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:02 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1589b-47de-4cd9-8f88-61ae9e6afd5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e7102-c480-440d-b37c-64f5e5ea4847]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:02 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac58af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af4dfb7-b2fd-4e75-97d3-82ec3df7c9e4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c23c97-a91f-4342-beec-2fa08781fb6f]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4e86f-b3e4-4d4a-928b-ebf84da2daab]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77d5c7-a4da-4f4d-8b6e-d8b4d73daba5]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4d5d2f-3bba-46d4-bdf6-bf8919008f22]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[891eb444-231e-449a-be78-7322dd5ee555]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260]
Nov 29 14:48:03 user nova-compute[75215]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d40410-5a9e-42cc-acd2-95e5eca013c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e72243-fd37-470c-92cb-d076d52c2840]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== disconnect_volume: return (698ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.368s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDzTPXIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a938b2-4e1a-45fc-bdfe-30051644cfc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]: iSNS:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]: STATIC:
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:03 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:03 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8217b308-5c0a-4c7a-ac2f-adb8ddc3ddbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d648b-4bbf-487f-b0fa-a0429ae1bbc8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb (non-flash)
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac58af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb'): ({'sdh'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Removing single pathed devices sdh {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] No waiting events found dispatching network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:03 user nova-compute[75215]: WARNING nova.compute.manager [req-2cc2f932-24a5-4e70-8819-195e842201cb req-a8f87be6-58bc-4918-8866-6f658eb83c06 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received unexpected event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d for instance with vm_state building and task_state spawning.
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe8f19-4baa-4c6b-9a58-a9978569cfe4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d8caf-36a6-46f6-8b61-16489a0d5ba9]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Flushing IO for device /dev/sdh {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a86339-560d-4081-8dff-9b2d3975e5b9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc01a5d-fc1a-426b-926c-06547ad2ff52]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] SCSI volumes sdh have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed2c64-1241-453c-abbe-8af8ca631dfb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19b335-45e1-4575-83fd-89d8008277ee]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260]
Nov 29 14:48:03 user nova-compute[75215]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdedb0e3-1dd9-4904-99b4-8cd3e8d8cbbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a185c0-e405-4faa-b7c5-2952a3a3ad3c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] <== disconnect_volume: return (726ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Deleting instance files /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c_del
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Deletion of /opt/stack/data/nova/instances/1567bac5-1f03-4c69-8951-f4d5c097d81c_del complete
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.362s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4883a2d2-a7c8-450a-835f-3dd712fd4015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]: iSNS:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]: STATIC:
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b
Nov 29 14:48:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:03 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:03 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:03 user nova-compute[75215]: No targets found.
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:03 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:03 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb3368-f246-44fc-b5f4-fcfc3cbe2c9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.compute.manager [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Took 8.75 seconds to destroy the instance on the hypervisor.
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d92502c-3976-4490-909f-92a6477fa0ff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:03 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b (non-flash)
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac4a8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b'): ({'sdg'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Removing single pathed devices sdg {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eb8322-d6fe-4c93-800b-1c07ea0cc04e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02897a32-5682-4900-8ebe-ad0ed3932930]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Flushing IO for device /dev/sdg {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6df715-f2b7-4d9f-bfca-7dc214c5e8d2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9c4c36-736a-40f6-9eae-7e803facd874]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a73ce0-a290-4a8a-9bff-292e6797287f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7457173d-dfec-4c08-a7d8-8fc1e28647a3]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260]
Nov 29 14:48:03 user nova-compute[75215]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca05f6aa-e0a7-426d-90a7-51b9c21f542b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d7f3f-464f-40eb-ba23-df8771356b5b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] <== disconnect_volume: return (681ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Deleting instance files /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927_del
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Deletion of /opt/stack/data/nova/instances/937930ff-fe15-4b44-a8fc-7a74bd86f927_del complete
Nov 29 14:48:03 user nova-compute[75215]: INFO nova.compute.manager [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Took 8.84 seconds to destroy the instance on the hypervisor.
Nov 29 14:48:03 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:48:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:48:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance spawned successfully.
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] No waiting events found dispatching network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:05 user nova-compute[75215]: WARNING nova.compute.manager [req-1640afc3-0c8b-48a0-a6b7-b5d079f4d2b6 req-d2b746d5-80c4-4137-825b-925457823259 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received unexpected event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d for instance with vm_state building and task_state spawning.
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:05 user nova-compute[75215]: INFO nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 29 14:48:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:48:05 user nova-compute[75215]: INFO nova.compute.manager [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Took 9.66 seconds to build instance.
Nov 29 14:48:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-24fc0661-6fd3-4d0c-8738-6b97c99723ff tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.923s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-e753fbcd-60b5-40b5-976c-424572ff0068 req-078433b1-8ffa-4188-ba7d-c7d150bb5fef service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-deleted-a7bafecb-a540-4ab4-a379-85898f0b67e8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:06 user nova-compute[75215]: INFO nova.compute.manager [req-e753fbcd-60b5-40b5-976c-424572ff0068 req-078433b1-8ffa-4188-ba7d-c7d150bb5fef service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Neutron deleted interface a7bafecb-a540-4ab4-a379-85898f0b67e8; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:06 user nova-compute[75215]: DEBUG nova.network.neutron [req-e753fbcd-60b5-40b5-976c-424572ff0068 req-078433b1-8ffa-4188-ba7d-c7d150bb5fef service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10f513d4-5565-4486-b7a3-c02eaedc9434", "address": "fa:16:3e:fa:ed:fe", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f513d4-55", "ovs_interfaceid": "10f513d4-5565-4486-b7a3-c02eaedc9434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-e753fbcd-60b5-40b5-976c-424572ff0068 req-078433b1-8ffa-4188-ba7d-c7d150bb5fef service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Detach interface failed, port_id=a7bafecb-a540-4ab4-a379-85898f0b67e8, reason: Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:06 user nova-compute[75215]: INFO nova.compute.manager [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Terminating instance
Nov 29 14:48:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-deleted-28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Neutron deleted interface 28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb05572-fee2-4539-8065-3819fee3b342", "address": "fa:16:3e:ad:d8:fa", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb05572-fe", "ovs_interfaceid": "1cb05572-fee2-4539-8065-3819fee3b342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Detach interface failed, port_id=28bc5a8f-f59e-47ae-a2f5-c9316fd6c0ee, reason: Instance 937930ff-fe15-4b44-a8fc-7a74bd86f927 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-deleted-1cb05572-fee2-4539-8065-3819fee3b342 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Neutron deleted interface 1cb05572-fee2-4539-8065-3819fee3b342; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [{"id": "8b7fb46f-2367-452e-8738-845846741434", "address": "fa:16:3e:4a:3d:e2", "network": {"id": "75c305f1-7031-4c11-a1a4-38333c6f677a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-585017842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7fb46f-23", "ovs_interfaceid": "8b7fb46f-2367-452e-8738-845846741434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "address": "fa:16:3e:ff:e9:48", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38d58a4-34", "ovs_interfaceid": "e38d58a4-34a4-4cc7-88a1-2c25c0f97045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31315a06-22c4-487d-888e-47d789df66b8", "address": "fa:16:3e:ea:33:d8", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31315a06-22", "ovs_interfaceid": "31315a06-22c4-487d-888e-47d789df66b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "184b5674-2b78-43fb-8969-f9002a50db6c", "address": "fa:16:3e:73:e4:30", "network": {"id": "b8a092a0-1da1-402d-b02d-59470d40d6e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-742827439", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184b5674-2b", "ovs_interfaceid": "184b5674-2b78-43fb-8969-f9002a50db6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "address": "fa:16:3e:f7:ba:fe", "network": {"id": "ba8221cc-9c94-439a-be11-f4b32f0f6061", "bridge": "br-int", "label": "tempest-device-tagging-net2-1181054451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab3d0f0a4beb48eb8eb4d3380268a11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd68b80a-ea", "ovs_interfaceid": "cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0f3e0b0-ac01-434c-a522-dbfc4c6145e7 req-5891a390-2c36-464a-8511-0440a85fab06 service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Detach interface failed, port_id=1cb05572-fee2-4539-8065-3819fee3b342, reason: Instance 937930ff-fe15-4b44-a8fc-7a74bd86f927 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Instance destroyed successfully.
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lazy-loading 'resources' on Instance uuid 12ca1bc5-8d9e-473b-953b-4e780e9c809c {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127863162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2127863162',id=8,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNA6uoEjeE7yBtMiglMKuKjQM5XW8M99qMNX5XpqK2/UkmsYJKjzCNA7CYhibT0uSntAgXrHdKO8CwFo1A6YqpxdggmqPdJ88hdf5hc2kZEa/uWA0y8ZxBJOcUlWu7uQ==',key_name='tempest-keypair-804131327',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cddd1c1589154bc090f15ab3dcc1f5c9',ramdisk_id='',reservation_id='r-cmyewzc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1908321058',owner_user_name='tempest-TaggedAttachmentsTest-1908321058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='919711e94a094e35829f21fe99dda832',uuid=12ca1bc5-8d9e-473b-953b-4e780e9c809c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converting VIF {"id": "372566fe-705b-4e33-a003-50c18348fa33", "address": "fa:16:3e:6a:4c:0f", "network": {"id": "bed85a4f-ff27-4198-b958-b7289310b1bb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-687824819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cddd1c1589154bc090f15ab3dcc1f5c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372566fe-70", "ovs_interfaceid": "372566fe-705b-4e33-a003-50c18348fa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG os_vif [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap372566fe-70, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3056d5d3-34e7-48a1-b3ce-2a4d4a97d798) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: INFO os_vif [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:4c:0f,bridge_name='br-int',has_traffic_filtering=True,id=372566fe-705b-4e33-a003-50c18348fa33,network=Network(bed85a4f-ff27-4198-b958-b7289310b1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372566fe-70')
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Deleting instance files /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c_del
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Deletion of /opt/stack/data/nova/instances/12ca1bc5-8d9e-473b-953b-4e780e9c809c_del complete
Nov 29 14:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:07 user nova-compute[75215]: INFO nova.compute.manager [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 14:48:07 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:48:07 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-deleted-10f513d4-5565-4486-b7a3-c02eaedc9434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:08 user nova-compute[75215]: INFO nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Neutron deleted interface 10f513d4-5565-4486-b7a3-c02eaedc9434; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "address": "fa:16:3e:f5:50:b1", "network": {"id": "6c8e2701-c39d-4afb-9133-16113045f934", "bridge": "br-int", "label": "tempest-device-tagging-net2-133509516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8493be-f7", "ovs_interfaceid": "4c8493be-f778-44b4-9d50-b7963f0b9dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Detach interface failed, port_id=10f513d4-5565-4486-b7a3-c02eaedc9434, reason: Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-deleted-4c8493be-f778-44b4-9d50-b7963f0b9dda {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:08 user nova-compute[75215]: INFO nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Neutron deleted interface 4c8493be-f778-44b4-9d50-b7963f0b9dda; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "address": "fa:16:3e:f5:c5:03", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67741ca5-e2", "ovs_interfaceid": "67741ca5-e257-4b30-927f-cd4cf2c74b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Detach interface failed, port_id=4c8493be-f778-44b4-9d50-b7963f0b9dda, reason: Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-deleted-67741ca5-e257-4b30-927f-cd4cf2c74b12 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:08 user nova-compute[75215]: INFO nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Neutron deleted interface 67741ca5-e257-4b30-927f-cd4cf2c74b12; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [{"id": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "address": "fa:16:3e:1f:78:8d", "network": {"id": "f1a7e538-d998-49f6-b85c-0b7560ac2ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-875941728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66dc7e57-be", "ovs_interfaceid": "66dc7e57-bef0-4007-a45a-80aeaa7b0e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "address": "fa:16:3e:32:b0:00", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa54c26-b6", "ovs_interfaceid": "9aa54c26-b6ed-4c5a-8d2b-1a8e602047fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c846958-280b-4134-bc9f-1d71a8895213", "address": "fa:16:3e:e6:19:09", "network": {"id": "d9938bbf-c8e3-48be-8873-c238d855049b", "bridge": "br-int", "label": "tempest-device-tagging-net1-164671911", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1dccd2d1a43f4aabbfce4440f4b1b04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c846958-28", "ovs_interfaceid": "3c846958-280b-4134-bc9f-1d71a8895213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4e22aaa-49c5-4c4f-8557-032484bd5fbc req-e858ef17-45fa-470e-888f-34ad4f335d5f service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Detach interface failed, port_id=67741ca5-e257-4b30-927f-cd4cf2c74b12, reason: Instance 1567bac5-1f03-4c69-8951-f4d5c097d81c could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:08 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:08 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Took 5.04 seconds to deallocate network for instance.
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:09 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22cc9c3-fae1-4108-b6fe-065494a5ff12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:48:09 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb8ad7-77d9-4d77-81c2-3e9b44282f63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db] added
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b46febe-55ee-40c3-95af-046621b66bbd]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d01c9-fbbf-4430-8e7b-74b659bbdab6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njQmlVbU {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njQmlVbU" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30e03f-9c04-4026-a1d0-1bbcfa0a6053]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njQmlVbU'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b11979-57b5-4e0e-9d5f-a96908d8e428]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319ef0c-f9cd-4e02-8ca2-07799622bb7d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b37820-036c-4cfe-b01e-d45b6260ba60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260]
Nov 29 14:48:09 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcec75c-6142-4bb6-b4c5-fad93ee90ba0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.074s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6549000-0e72-46cc-b678-cb3e3649796a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:09 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3901caf0-9263-4e1a-8631-81593edab5c7]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-unplugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-unplugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-unplugged-372566fe-705b-4e33-a003-50c18348fa33 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-deleted-8b7fb46f-2367-452e-8738-845846741434 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Acquiring lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] No waiting events found dispatching network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:09 user nova-compute[75215]: WARNING nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received unexpected event network-vif-plugged-372566fe-705b-4e33-a003-50c18348fa33 for instance with vm_state active and task_state deleting.
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-deleted-184b5674-2b78-43fb-8969-f9002a50db6c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-28752f51-a47c-44c4-b93a-e0b778101322 req-e82ee4cc-84e0-438c-a93e-131e5534077a service nova] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Received event network-vif-deleted-cd68b80a-ea35-4ae6-88b2-4b4c23bcae9f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_requests' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'numa_topology' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:10 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Took 2.49 seconds to deallocate network for instance.
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:48:10 user nova-compute[75215]: INFO nova.compute.claims [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Claim successful on node user
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:10 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Took 6.99 seconds to deallocate network for instance.
Nov 29 14:48:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26531353636643765', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531353636643765', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'flavor' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:48:10 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:48:10 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:48:10 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:48:10 user nova-compute[75215]:   <serial>ce68cdba-83fd-46cd-8f87-58e082a648db</serial>
Nov 29 14:48:10 user nova-compute[75215]: </disk>
Nov 29 14:48:10 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:48:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-1f2f65b2-b264-4542-8c60-ff2f6fb6e9b1 req-94f2cde0-d4aa-44ff-9058-ae9e793e14c4 service nova] [instance: 12ca1bc5-8d9e-473b-953b-4e780e9c809c] Received event network-vif-deleted-372566fe-705b-4e33-a003-50c18348fa33 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-1f2f65b2-b264-4542-8c60-ff2f6fb6e9b1 req-94f2cde0-d4aa-44ff-9058-ae9e793e14c4 service nova] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Received event network-vif-deleted-66dc7e57-bef0-4007-a45a-80aeaa7b0e70 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.594s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No VIF found with MAC fa:16:3e:23:8d:64, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:48:11 user nova-compute[75215]: INFO nova.network.neutron [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating port 115a6cca-db08-49e7-9978-7b78f2fbf532 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7127c021-1204-4b5b-a576-010c2aa7912a tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.993s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:11 user nova-compute[75215]: INFO nova.compute.manager [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] [instance: 937930ff-fe15-4b44-a8fc-7a74bd86f927] Took 2.73 seconds to detach 3 volumes for instance.
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:11 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Deleted allocations for instance 12ca1bc5-8d9e-473b-953b-4e780e9c809c
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f5b0743-2208-47fb-a642-744d899c3ddc tempest-TaggedAttachmentsTest-1908321058 tempest-TaggedAttachmentsTest-1908321058-project-member] Lock "12ca1bc5-8d9e-473b-953b-4e780e9c809c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.067s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:12 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Deleted allocations for instance 937930ff-fe15-4b44-a8fc-7a74bd86f927
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-029ed9cc-ff31-4ca9-9f37-53108d506f3c tempest-TaggedBootDevicesTest_v242-1966625572 tempest-TaggedBootDevicesTest_v242-1966625572-project-member] Lock "937930ff-fe15-4b44-a8fc-7a74bd86f927" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.338s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:12 user nova-compute[75215]: INFO nova.compute.manager [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Rescuing
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:12 user nova-compute[75215]: INFO nova.compute.manager [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] [instance: 1567bac5-1f03-4c69-8951-f4d5c097d81c] Took 2.45 seconds to detach 3 volumes for instance.
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing instance network info cache due to event network-changed-115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] Acquiring lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:13 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Deleted allocations for instance 1567bac5-1f03-4c69-8951-f4d5c097d81c
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8122ae-22e8-4013-9ec9-6ce1061ef524 tempest-TaggedBootDevicesTest-2130810757 tempest-TaggedBootDevicesTest-2130810757-project-member] Lock "1567bac5-1f03-4c69-8951-f4d5c097d81c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.750s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:48:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Creating image(s)
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] Acquired lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Refreshing network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG nova.objects.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "385af15bbf84b2b7c646faf456b494f4603e817e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "385af15bbf84b2b7c646faf456b494f4603e817e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:14 user nova-compute[75215]: WARNING nova.compute.manager [req-bd5f486f-cbf0-4290-95f3-74bb1cb8608d req-9f060b0b-a596-4f64-844f-a33632be9213 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state rescuing.
Nov 29 14:48:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance destroyed successfully.
Nov 29 14:48:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attempting a stable device rescue
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:48:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Creating image(s)
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'trusted_certs' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.virt.images [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] 0efa234d-8b43-435e-b2a8-51f037ef7d7a was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:48:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.part /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.part /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.converted" returned: 0 in 1.069s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:16 user nova-compute[75215]: WARNING nova.compute.manager [req-5a7f1238-164d-41c9-be74-e9e9a28d64b9 req-8e14fc4c-b796-4808-ba9d-f922eeaf23aa service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state rescuing.
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.virt.images [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] 302bd0b0-d00a-4357-bc32-039500fe105b was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.part /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "385af15bbf84b2b7c646faf456b494f4603e817e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.569s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updated VIF entry in instance network info cache for port 115a6cca-db08-49e7-9978-7b78f2fbf532. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a7b878d6-79a9-4b6e-8b20-96687c256e1e req-0ee21405-aff9-452b-a5d3-bf70924359af service nova] Releasing lock "refresh_cache-ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "385af15bbf84b2b7c646faf456b494f4603e817e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "385af15bbf84b2b7c646faf456b494f4603e817e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json" returned: 0 in 0.266s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e,backing_fmt=raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e,backing_fmt=raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk 1073741824" returned: 0 in 0.076s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "385af15bbf84b2b7c646faf456b494f4603e817e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'migration_context' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Rebasing disk image.
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.part /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.converted" returned: 0 in 0.932s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c -F raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.420s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7,backing_fmt=raw /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7,backing_fmt=raw /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "bf2e9356beb1f4429dad2f6832272ed9df2c47a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'migration_context' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Object Instance<fae0e81c-9fcc-4a56-a9eb-876c830820b2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start _get_guest_xml network_info=[{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "vif_mac": "fa:16:3e:23:8d:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '302bd0b0-d00a-4357-bc32-039500fe105b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'bfb92b27-26a1-49fd-a8f0-59d0fb3ff400', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fae0e81c-9fcc-4a56-a9eb-876c830820b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce68cdba-83fd-46cd-8f87-58e082a648db', 'serial': 'ce68cdba-83fd-46cd-8f87-58e082a648db'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'resources' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Object Instance<fae0e81c-9fcc-4a56-a9eb-876c830820b2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'numa_topology' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Object Instance<fae0e81c-9fcc-4a56-a9eb-876c830820b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'vcpu_model' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.objects.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Object Instance<fae0e81c-9fcc-4a56-a9eb-876c830820b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:17 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:17 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:17 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d6f81a-5d87-45af-8293-138637e91fdf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = njQmlVbU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 14:48:17 user nova-compute[75215]: node.name = iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:48:17 user nova-compute[75215]: node.tpgt = -1
Nov 29 14:48:17 user nova-compute[75215]: node.startup = automatic
Nov 29 14:48:17 user nova-compute[75215]: node.leading_login = No
Nov 29 14:48:17 user nova-compute[75215]: iface.iscsi_ifacename = default
Nov 29 14:48:17 user nova-compute[75215]: iface.net_ifacename = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.ipaddress = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.prefix_len = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.hwaddress = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.transport_name = tcp
Nov 29 14:48:17 user nova-compute[75215]: iface.initiatorname = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.vlan_id = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.vlan_priority = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.vlan_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.iface_num = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.mtu = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.port = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.bootproto = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.subnet_mask = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.gateway = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_alt_client_id = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_dns = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_learn_iqn = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_vendor_id_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_vendor_id = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.dhcp_slp_da = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.fragmentation = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.gratuitous_arp = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.incoming_forwarding = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.tos_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.tos = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.ttl = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.delayed_ack = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.tcp_nagle = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.tcp_wsf_state = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.tcp_wsf = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.tcp_timer_scale = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.tcp_timestamp = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.redirect = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.def_task_mgmt_timeout = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.header_digest = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.data_digest = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.immediate_data = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.initial_r2t = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.data_seq_inorder = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.data_pdu_inorder = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.erl = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.max_receive_data_len = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.first_burst_len = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.max_outstanding_r2t = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.max_burst_len = 0
Nov 29 14:48:17 user nova-compute[75215]: iface.chap_auth = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.bidi_chap = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.strict_login_compliance = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.discovery_auth = <empty>
Nov 29 14:48:17 user nova-compute[75215]: iface.discovery_logout = <empty>
Nov 29 14:48:17 user nova-compute[75215]: node.discovery_address = <empty>
Nov 29 14:48:17 user nova-compute[75215]: node.discovery_port = 0
Nov 29 14:48:17 user nova-compute[75215]: node.discovery_type = static
Nov 29 14:48:17 user nova-compute[75215]: node.session.initial_cmdsn = 0
Nov 29 14:48:17 user nova-compute[75215]: node.session.initial_login_retry_max = 8
Nov 29 14:48:17 user nova-compute[75215]: node.session.xmit_thread_priority = -20
Nov 29 14:48:17 user nova-compute[75215]: node.session.cmds_max = 128
Nov 29 14:48:17 user nova-compute[75215]: node.session.queue_depth = 32
Nov 29 14:48:17 user nova-compute[75215]: node.session.nr_sessions = 1
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.authmethod = CHAP
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.username = njQmlVbU
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.password = ***
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.username_in = <empty>
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.password_in = <empty>
Nov 29 14:48:17 user nova-compute[75215]: node.session.auth.chap_algs = MD5
Nov 29 14:48:17 user nova-compute[75215]: node.session.timeo.replacement_timeout = 120
Nov 29 14:48:17 user nova-compute[75215]: node.session.err_timeo.abort_timeout = 15
Nov 29 14:48:17 user nova-compute[75215]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 14:48:17 user nova-compute[75215]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 14:48:17 user nova-compute[75215]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.FastAbort = Yes
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.InitialR2T = No
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.ImmediateData = Yes
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.MaxConnections = 1
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 14:48:17 user nova-compute[75215]: node.session.iscsi.ERL = 0
Nov 29 14:48:17 user nova-compute[75215]: node.session.scan = manual
Nov 29 14:48:17 user nova-compute[75215]: node.session.reopen_max = 0
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].address = 172.16.0.220
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].port = 3260
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].startup = manual
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].tcp.window_size = 524288
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].tcp.type_of_service = 0
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].timeo.logout_timeout = 15
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].timeo.login_timeout = 15
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].timeo.auth_timeout = 45
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.DataDigest = None
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.IFMarker = No
Nov 29 14:48:17 user nova-compute[75215]: node.conn[0].iscsi.OFMarker = No
Nov 29 14:48:17 user nova-compute[75215]: # END RECORD
Nov 29 14:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f584df7b-9edc-44d3-b823-3d818c2be552]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72845c-abb6-4b90-b3c2-6e0f3f1c13a3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njQmlVbU {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njQmlVbU" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc494b-7106-43ee-9ad9-be75eb6a12e2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njQmlVbU'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed234898-d465-480c-8e3c-96716a1e3800]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc88aa-21df-463d-b86b-ed8321ab2bdd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:17 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:17 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a55fce1-eb97-41c0-a216-7ba925468963]: (4, ('0 0 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.286s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] <== connect_volume: return (287ms) {'type': 'block', 'scsi_wwn': '26531353636643765', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531353636643765', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-9420683',display_name='tempest-ServerStableDeviceRescueTest-server-9420683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-9420683',id=3,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8l9zcAEfUJXLwxmzSZOyd4p4+vXl/nKxXU8V2PI2b/26W84tahbT/rs54F6AwquAB8jS4d6Y7URrR2u/52PAQ7tNAFyIGq0BuJQ6i2FCjlQKPS/1rNird42qquTp52ww==',key_name='tempest-keypair-468001882',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bbf5053f1114a2aa4ed9a5ed0d51614',ramdisk_id='',reservation_id='r-f63jdpqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-551332558',owner_user_name='tempest-ServerStableDeviceRescueTest-551332558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a063f501a31542d697e9d55b0cfae654',uuid=fae0e81c-9fcc-4a56-a9eb-876c830820b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "vif_mac": "fa:16:3e:23:8d:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converting VIF {"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "vif_mac": "fa:16:3e:23:8d:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'pci_devices' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.objects.base [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Object Instance<fae0e81c-9fcc-4a56-a9eb-876c830820b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:48:18 user nova-compute[75215]:   <uuid>fae0e81c-9fcc-4a56-a9eb-876c830820b2</uuid>
Nov 29 14:48:18 user nova-compute[75215]:   <name>instance-00000003</name>
Nov 29 14:48:18 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:48:18 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:48:18 user nova-compute[75215]:   <metadata>
Nov 29 14:48:18 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:48:18 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-9420683</nova:name>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:48:17</nova:creationTime>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:48:18 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:48:18 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:owner>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:user uuid="a063f501a31542d697e9d55b0cfae654">tempest-ServerStableDeviceRescueTest-551332558-project-member</nova:user>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:project uuid="6bbf5053f1114a2aa4ed9a5ed0d51614">tempest-ServerStableDeviceRescueTest-551332558</nova:project>
Nov 29 14:48:18 user nova-compute[75215]:       </nova:owner>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:48:18 user nova-compute[75215]:       <nova:ports>
Nov 29 14:48:18 user nova-compute[75215]:         <nova:port uuid="53921259-ca48-418b-959d-c373a73a6807">
Nov 29 14:48:18 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:48:18 user nova-compute[75215]:         </nova:port>
Nov 29 14:48:18 user nova-compute[75215]:       </nova:ports>
Nov 29 14:48:18 user nova-compute[75215]:     </nova:instance>
Nov 29 14:48:18 user nova-compute[75215]:   </metadata>
Nov 29 14:48:18 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:48:18 user nova-compute[75215]:     <system>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="serial">fae0e81c-9fcc-4a56-a9eb-876c830820b2</entry>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="uuid">fae0e81c-9fcc-4a56-a9eb-876c830820b2</entry>
Nov 29 14:48:18 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:48:18 user nova-compute[75215]:     </system>
Nov 29 14:48:18 user nova-compute[75215]:   </sysinfo>
Nov 29 14:48:18 user nova-compute[75215]:   <os>
Nov 29 14:48:18 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:48:18 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:48:18 user nova-compute[75215]:   </os>
Nov 29 14:48:18 user nova-compute[75215]:   <features>
Nov 29 14:48:18 user nova-compute[75215]:     <acpi/>
Nov 29 14:48:18 user nova-compute[75215]:     <apic/>
Nov 29 14:48:18 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:48:18 user nova-compute[75215]:   </features>
Nov 29 14:48:18 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:48:18 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:48:18 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:48:18 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:48:18 user nova-compute[75215]:   </clock>
Nov 29 14:48:18 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:48:18 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:48:18 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:48:18 user nova-compute[75215]:   </cpu>
Nov 29 14:48:18 user nova-compute[75215]:   <devices>
Nov 29 14:48:18 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:48:18 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:48:18 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk"/>
Nov 29 14:48:18 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:48:18 user nova-compute[75215]:     </disk>
Nov 29 14:48:18 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:48:18 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:48:18 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 14:48:18 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:48:18 user nova-compute[75215]:       <serial>ce68cdba-83fd-46cd-8f87-58e082a648db</serial>
Nov 29 14:48:18 user nova-compute[75215]:     </disk>
Nov 29 14:48:18 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:48:18 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:48:18 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue"/>
Nov 29 14:48:18 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 29 14:48:18 user nova-compute[75215]:       <boot order="1"/>
Nov 29 14:48:18 user nova-compute[75215]:     </disk>
Nov 29 14:48:18 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:48:18 user nova-compute[75215]:       <mac address="fa:16:3e:23:8d:64"/>
Nov 29 14:48:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:18 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:48:18 user nova-compute[75215]:       <target dev="tap53921259-ca"/>
Nov 29 14:48:18 user nova-compute[75215]:     </interface>
Nov 29 14:48:18 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:48:18 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/console.log" append="off"/>
Nov 29 14:48:18 user nova-compute[75215]:     </serial>
Nov 29 14:48:18 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:48:18 user nova-compute[75215]:     <video>
Nov 29 14:48:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:18 user nova-compute[75215]:     </video>
Nov 29 14:48:18 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:48:18 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:48:18 user nova-compute[75215]:     </rng>
Nov 29 14:48:18 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:48:18 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:48:18 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:48:18 user nova-compute[75215]:     </memballoon>
Nov 29 14:48:18 user nova-compute[75215]:   </devices>
Nov 29 14:48:18 user nova-compute[75215]: </domain>
Nov 29 14:48:18 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:48:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance destroyed successfully.
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] No VIF found with MAC fa:16:3e:23:8d:64, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c -F raw /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk" returned: 0 in 3.426s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Ensure instance console log exists: /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start _get_guest_xml network_info=[{"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d47f40fe444c104f00159798589457fa',container_format='bare',created_at=2023-11-29T14:46:06Z,direct_url=<?>,disk_format='qcow2',id=0efa234d-8b43-435e-b2a8-51f037ef7d7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-720794654-shelved',owner='bce0446252d5486794553a9cae9281af',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T14:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7511325b-bd93-4cce-90db-439314b0e0cc', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBkmsbAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9', 'attached_at': '', 'detached_at': '', 'volume_id': '071b175e-acc2-4f2e-ba01-4182dbd5126b', 'serial': '071b175e-acc2-4f2e-ba01-4182dbd5126b'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:48:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d47f40fe444c104f00159798589457fa',container_format='bare',created_at=2023-11-29T14:46:06Z,direct_url=<?>,disk_format='qcow2',id=0efa234d-8b43-435e-b2a8-51f037ef7d7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-720794654-shelved',owner='bce0446252d5486794553a9cae9281af',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T14:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.objects.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBkmsbAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:20 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:20 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:20 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0274b-b2a4-47eb-bc1d-7a133db17b2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:48:20 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14244ffa-51d0-4090-979b-befeb5a87395]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b] added
Nov 29 14:48:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b208fc3e-4108-4593-b110-4a50056edde5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aeb482-ef92-40ce-a5ee-e3a59f5ef288]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBkmsbAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBkmsbAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805b038-8183-4e62-bc8c-2ef82f4943fe]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBkmsbAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba87579-d767-474a-80d1-3cf9f9d500c2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11028f5d-96fa-4f9a-919b-51953a4691df]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:20 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:20 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:20 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:20 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b1f3a-4b78-419e-97b3-0a0b592057b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260]
Nov 29 14:48:21 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac92153-de0e-47d8-bf1a-63c38c5167de]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c9f4d-351b-4559-ab03-82884e109f7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:48:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:21 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:48:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.118s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd944e-f93b-49d5-b07f-ccd254a0ede8]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:21 user nova-compute[75215]: WARNING nova.compute.manager [req-20586574-c04f-40fd-8705-acf99f9b48fb req-a6ca0289-0dd0-45ed-90b4-e9006fc42861 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state rescuing.
Nov 29 14:48:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBkmsbAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23162373430616665', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162373430616665', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='0efa234d-8b43-435e-b2a8-51f037ef7d7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-786004936',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:46:12.473954',shelved_host='user',shelved_image_id='0efa234d-8b43-435e-b2a8-51f037ef7d7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_devices' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.objects.base [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:48:22 user nova-compute[75215]:   <uuid>ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</uuid>
Nov 29 14:48:22 user nova-compute[75215]:   <name>instance-00000002</name>
Nov 29 14:48:22 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:48:22 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:48:22 user nova-compute[75215]:   <metadata>
Nov 29 14:48:22 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:48:22 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-720794654</nova:name>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:48:20</nova:creationTime>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:48:22 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:48:22 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:owner>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:user uuid="21f3cbb55df1494f94e304bfc82c4c5c">tempest-AttachVolumeShelveTestJSON-1453470125-project-member</nova:user>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:project uuid="bce0446252d5486794553a9cae9281af">tempest-AttachVolumeShelveTestJSON-1453470125</nova:project>
Nov 29 14:48:22 user nova-compute[75215]:       </nova:owner>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:root type="image" uuid="0efa234d-8b43-435e-b2a8-51f037ef7d7a"/>
Nov 29 14:48:22 user nova-compute[75215]:       <nova:ports>
Nov 29 14:48:22 user nova-compute[75215]:         <nova:port uuid="115a6cca-db08-49e7-9978-7b78f2fbf532">
Nov 29 14:48:22 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 14:48:22 user nova-compute[75215]:         </nova:port>
Nov 29 14:48:22 user nova-compute[75215]:       </nova:ports>
Nov 29 14:48:22 user nova-compute[75215]:     </nova:instance>
Nov 29 14:48:22 user nova-compute[75215]:   </metadata>
Nov 29 14:48:22 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:48:22 user nova-compute[75215]:     <system>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="serial">ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</entry>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="uuid">ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9</entry>
Nov 29 14:48:22 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:48:22 user nova-compute[75215]:     </system>
Nov 29 14:48:22 user nova-compute[75215]:   </sysinfo>
Nov 29 14:48:22 user nova-compute[75215]:   <os>
Nov 29 14:48:22 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:48:22 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:48:22 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:48:22 user nova-compute[75215]:   </os>
Nov 29 14:48:22 user nova-compute[75215]:   <features>
Nov 29 14:48:22 user nova-compute[75215]:     <acpi/>
Nov 29 14:48:22 user nova-compute[75215]:     <apic/>
Nov 29 14:48:22 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:48:22 user nova-compute[75215]:   </features>
Nov 29 14:48:22 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:48:22 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:48:22 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:48:22 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:48:22 user nova-compute[75215]:   </clock>
Nov 29 14:48:22 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:48:22 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:48:22 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:48:22 user nova-compute[75215]:   </cpu>
Nov 29 14:48:22 user nova-compute[75215]:   <devices>
Nov 29 14:48:22 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:48:22 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:48:22 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk"/>
Nov 29 14:48:22 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:48:22 user nova-compute[75215]:     </disk>
Nov 29 14:48:22 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:48:22 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:48:22 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 14:48:22 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 29 14:48:22 user nova-compute[75215]:       <serial>071b175e-acc2-4f2e-ba01-4182dbd5126b</serial>
Nov 29 14:48:22 user nova-compute[75215]:     </disk>
Nov 29 14:48:22 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:48:22 user nova-compute[75215]:       <mac address="fa:16:3e:3e:8a:97"/>
Nov 29 14:48:22 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:22 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:48:22 user nova-compute[75215]:       <target dev="tap115a6cca-db"/>
Nov 29 14:48:22 user nova-compute[75215]:     </interface>
Nov 29 14:48:22 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:48:22 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/console.log" append="off"/>
Nov 29 14:48:22 user nova-compute[75215]:     </serial>
Nov 29 14:48:22 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:48:22 user nova-compute[75215]:     <video>
Nov 29 14:48:22 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:22 user nova-compute[75215]:     </video>
Nov 29 14:48:22 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:48:22 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:48:22 user nova-compute[75215]:     </rng>
Nov 29 14:48:22 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:48:22 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:48:22 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:48:22 user nova-compute[75215]:     </memballoon>
Nov 29 14:48:22 user nova-compute[75215]:   </devices>
Nov 29 14:48:22 user nova-compute[75215]: </domain>
Nov 29 14:48:22 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='0efa234d-8b43-435e-b2a8-51f037ef7d7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-786004936',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:46:12.473954',shelved_host='user',shelved_image_id='0efa234d-8b43-435e-b2a8-51f037ef7d7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG os_vif [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '633ac06f-77c1-51c6-870c-5c508271bb8a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap115a6cca-db, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap115a6cca-db, col_values=(('qos', UUID('04923174-cc16-43e1-ba31-b9656d532cf8')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap115a6cca-db, col_values=(('external_ids', {'iface-id': '115a6cca-db08-49e7-9978-7b78f2fbf532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:8a:97', 'vm-uuid': 'ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:22 user nova-compute[75215]: INFO os_vif [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db')
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No VIF found with MAC fa:16:3e:3e:8a:97, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:23 user nova-compute[75215]: WARNING nova.compute.manager [req-301c78b6-d559-4084-bcf2-948fb60c5a35 req-768f3d7c-c4e7-46b5-80c2-cc532424971d service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state rescuing.
Nov 29 14:48:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-01c869e9-339e-4a73-9263-bbf8ab233a3e tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:25 user nova-compute[75215]: WARNING nova.compute.manager [req-21d77535-743a-4590-84ca-579e56056adb req-a3536c63-b3fe-45ba-8ab9-1b8bb7621ab3 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 14:48:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:48:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:48:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance spawned successfully.
Nov 29 14:48:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:48:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ce065fe9-f518-4bce-9035-afc9df9a9572 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.041s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:27 user nova-compute[75215]: WARNING nova.compute.manager [req-ed25511b-f232-4750-8355-77fba70e5b47 req-e1e1b137-3ebe-445e-9435-f204baf93d12 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state active and task_state None.
Nov 29 14:48:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:48:28 user nova-compute[75215]: INFO nova.compute.claims [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Claim successful on node user
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:48:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.policy [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd88477198b5d411f9e193afdb9f40e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e6a6477d6b4664a2f0de1b0bdc15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:48:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Creating image(s)
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.249s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk 1073741824" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Successfully created port: a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Cannot resize image /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Ensure instance console log exists: /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Successfully updated port: a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquired lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received event network-changed-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Refreshing instance network info cache due to event network-changed-a8343a72-9a9d-41cb-a5ee-23858483aae3. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] Acquiring lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updating instance_info_cache with network_info: [{"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Releasing lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Instance network_info: |[{"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] Acquired lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Refreshing network info cache for port a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Start _get_guest_xml network_info=[{"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:48:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363393676',display_name='tempest-AttachVolumeNegativeTest-server-1363393676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363393676',id=17,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBSX2xiZCxXbMRbMFlR1j0Au3W6ybJFNFKZK6BKl04zZ2wikQfF3/gwa2c092/Zhh1hqyeSqHYn30yyJQ2hnfYzy/E5Rtql2SPE3ok0lee4uUbEczTfxti6K6gkeBNvYQ==',key_name='tempest-keypair-1798030685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-o3kfkejj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=5ce57ec1-587f-4d44-bce2-46cc4b4554ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:48:31 user nova-compute[75215]:   <uuid>5ce57ec1-587f-4d44-bce2-46cc4b4554ab</uuid>
Nov 29 14:48:31 user nova-compute[75215]:   <name>instance-00000011</name>
Nov 29 14:48:31 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:48:31 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:48:31 user nova-compute[75215]:   <metadata>
Nov 29 14:48:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:48:31 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1363393676</nova:name>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:48:31</nova:creationTime>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:48:31 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:48:31 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:owner>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:user uuid="d88477198b5d411f9e193afdb9f40e03">tempest-AttachVolumeNegativeTest-1682890616-project-member</nova:user>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:project uuid="35e6a6477d6b4664a2f0de1b0bdc15e2">tempest-AttachVolumeNegativeTest-1682890616</nova:project>
Nov 29 14:48:31 user nova-compute[75215]:       </nova:owner>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:48:31 user nova-compute[75215]:       <nova:ports>
Nov 29 14:48:31 user nova-compute[75215]:         <nova:port uuid="a8343a72-9a9d-41cb-a5ee-23858483aae3">
Nov 29 14:48:31 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:48:31 user nova-compute[75215]:         </nova:port>
Nov 29 14:48:31 user nova-compute[75215]:       </nova:ports>
Nov 29 14:48:31 user nova-compute[75215]:     </nova:instance>
Nov 29 14:48:31 user nova-compute[75215]:   </metadata>
Nov 29 14:48:31 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:48:31 user nova-compute[75215]:     <system>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="serial">5ce57ec1-587f-4d44-bce2-46cc4b4554ab</entry>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="uuid">5ce57ec1-587f-4d44-bce2-46cc4b4554ab</entry>
Nov 29 14:48:31 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:48:31 user nova-compute[75215]:     </system>
Nov 29 14:48:31 user nova-compute[75215]:   </sysinfo>
Nov 29 14:48:31 user nova-compute[75215]:   <os>
Nov 29 14:48:31 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:48:31 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:48:31 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:48:31 user nova-compute[75215]:   </os>
Nov 29 14:48:31 user nova-compute[75215]:   <features>
Nov 29 14:48:31 user nova-compute[75215]:     <acpi/>
Nov 29 14:48:31 user nova-compute[75215]:     <apic/>
Nov 29 14:48:31 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:48:31 user nova-compute[75215]:   </features>
Nov 29 14:48:31 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:48:31 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:48:31 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:48:31 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:48:31 user nova-compute[75215]:   </clock>
Nov 29 14:48:31 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:48:31 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:48:31 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:48:31 user nova-compute[75215]:   </cpu>
Nov 29 14:48:31 user nova-compute[75215]:   <devices>
Nov 29 14:48:31 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:48:31 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:48:31 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk"/>
Nov 29 14:48:31 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:48:31 user nova-compute[75215]:     </disk>
Nov 29 14:48:31 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:48:31 user nova-compute[75215]:       <mac address="fa:16:3e:24:d8:c5"/>
Nov 29 14:48:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:31 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:48:31 user nova-compute[75215]:       <target dev="tapa8343a72-9a"/>
Nov 29 14:48:31 user nova-compute[75215]:     </interface>
Nov 29 14:48:31 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:48:31 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/console.log" append="off"/>
Nov 29 14:48:31 user nova-compute[75215]:     </serial>
Nov 29 14:48:31 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:48:31 user nova-compute[75215]:     <video>
Nov 29 14:48:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:48:31 user nova-compute[75215]:     </video>
Nov 29 14:48:31 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:48:31 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:48:31 user nova-compute[75215]:     </rng>
Nov 29 14:48:31 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:48:31 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:48:31 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:48:31 user nova-compute[75215]:     </memballoon>
Nov 29 14:48:31 user nova-compute[75215]:   </devices>
Nov 29 14:48:31 user nova-compute[75215]: </domain>
Nov 29 14:48:31 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363393676',display_name='tempest-AttachVolumeNegativeTest-server-1363393676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363393676',id=17,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBSX2xiZCxXbMRbMFlR1j0Au3W6ybJFNFKZK6BKl04zZ2wikQfF3/gwa2c092/Zhh1hqyeSqHYn30yyJQ2hnfYzy/E5Rtql2SPE3ok0lee4uUbEczTfxti6K6gkeBNvYQ==',key_name='tempest-keypair-1798030685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-o3kfkejj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=5ce57ec1-587f-4d44-bce2-46cc4b4554ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG os_vif [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de811230-a6fc-5519-955a-5102333f9649', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8343a72-9a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8343a72-9a, col_values=(('qos', UUID('c1f43589-8f78-4816-a312-7d7c92ad04d6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8343a72-9a, col_values=(('external_ids', {'iface-id': 'a8343a72-9a9d-41cb-a5ee-23858483aae3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:d8:c5', 'vm-uuid': '5ce57ec1-587f-4d44-bce2-46cc4b4554ab'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:31 user nova-compute[75215]: INFO os_vif [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a')
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:24:d8:c5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updated VIF entry in instance network info cache for port a8343a72-9a9d-41cb-a5ee-23858483aae3. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updating instance_info_cache with network_info: [{"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73e507f2-9752-4003-8259-970f46e6d695 req-3fb9fa73-8e02-46fb-9630-ce829f9a04bb service nova] Releasing lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received event network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] No waiting events found dispatching network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:33 user nova-compute[75215]: WARNING nova.compute.manager [req-0635921f-4f02-4158-8ed0-e2005f8542b4 req-0d40e5d0-8a23-4188-aec8-e494db498185 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received unexpected event network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 for instance with vm_state building and task_state spawning.
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:35 user nova-compute[75215]: INFO nova.compute.manager [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Terminating instance
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:48:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Instance spawned successfully.
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received event network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] No waiting events found dispatching network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:35 user nova-compute[75215]: WARNING nova.compute.manager [req-8c84a226-e03f-473f-ab95-4f856eadd587 req-0884f226-a3fb-4214-8804-ba6bdef11998 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received unexpected event network-vif-plugged-a8343a72-9a9d-41cb-a5ee-23858483aae3 for instance with vm_state building and task_state spawning.
Nov 29 14:48:35 user nova-compute[75215]: INFO nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 29 14:48:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:48:35 user nova-compute[75215]: INFO nova.compute.manager [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Took 7.05 seconds to build instance.
Nov 29 14:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50c7bcad-2db6-4329-a7dd-ac3f44835694 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.171s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Instance destroyed successfully.
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lazy-loading 'resources' on Instance uuid c83d839d-ee08-4c71-b1ce-6b235b33fbbe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1950333669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1520580212',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4Prx6O+w/+db4wuLEzsB6z6rQLGLUeBtDyj02CtkjJtJvmBbxzvGxo0tOqMjHjorA4qBmEQAugxAEOLefw2Lu6kIGeW5mMmAZMRGcf6VXzpbtFVap+ZvqC4iG4M+06w==',key_name='tempest-keypair-1463216075',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='932cb09f754945fcae5d455d0e692306',ramdisk_id='',reservation_id='r-aii2b4ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-521197919',owner_user_name='tempest-ServerActionsV293TestJSON-521197919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ffdcd4720648109006852e64f0d42d',uuid=c83d839d-ee08-4c71-b1ce-6b235b33fbbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converting VIF {"id": "e387612b-0d73-403b-b9b1-8c83fe20429f", "address": "fa:16:3e:53:d8:f7", "network": {"id": "9903e572-b8a5-45c4-be10-ebeca8da2fb8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1800359389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "932cb09f754945fcae5d455d0e692306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape387612b-0d", "ovs_interfaceid": "e387612b-0d73-403b-b9b1-8c83fe20429f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_vif [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape387612b-0d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52122407-991d-4d47-9d62-cf9f6008a780) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:36 user nova-compute[75215]: INFO os_vif [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d8:f7,bridge_name='br-int',has_traffic_filtering=True,id=e387612b-0d73-403b-b9b1-8c83fe20429f,network=Network(9903e572-b8a5-45c4-be10-ebeca8da2fb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape387612b-0d')
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTAIUnGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:48:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2fa06-631b-4ce4-92c0-d2f535bc53c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:48:36 user nova-compute[75215]: No targets found.
Nov 29 14:48:36 user nova-compute[75215]: iSNS:
Nov 29 14:48:36 user nova-compute[75215]: No targets found.
Nov 29 14:48:36 user nova-compute[75215]: STATIC:
Nov 29 14:48:36 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:48:36 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:36 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:36 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b
Nov 29 14:48:36 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:36 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:36 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:48:36 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:36 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:36 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5
Nov 29 14:48:36 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:48:36 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:48:36 user nova-compute[75215]: FIRMWARE:
Nov 29 14:48:36 user nova-compute[75215]: No targets found.
Nov 29 14:48:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:48:36 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:48:36 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc8b85-da2d-4865-8f66-dc7a98989fe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30660646-56c2-415c-a429-fdc9685802a9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:48:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:48:36 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:48:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887de0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615feef-d532-47de-bdbd-1e2a8710bcb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01163331-d89e-4ae6-9149-09ea9165393a]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[632149ce-4e1a-4531-8837-1dd077c02c23]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1744b9d5-47f5-4b23-a8b1-11bf40ed09db]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26133326163353033', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3b3637', '/dev/disk/by-id/scsi-1SCST_BIOd3b3637-a32ac5039d76677e') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08675f4a-108b-4281-a765-4df1bfdf0a0e]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb00ed-a844-4ed0-a29a-12a67733455a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a830d-a979-416a-becc-bc598e281646]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260]
Nov 29 14:48:36 user nova-compute[75215]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5, portal: 172.16.0.220,3260] successful.
Nov 29 14:48:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:750c2cb0-00d2-423b-b2ac-4f80811a58e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc940901-fc78-4e9b-9006-ec28dc2c1a24]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] <== disconnect_volume: return (459ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:48:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deleting instance files /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe_del
Nov 29 14:48:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deletion of /opt/stack/data/nova/instances/c83d839d-ee08-4c71-b1ce-6b235b33fbbe_del complete
Nov 29 14:48:36 user nova-compute[75215]: INFO nova.compute.manager [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 29 14:48:36 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:48:36 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-unplugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Acquiring lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] No waiting events found dispatching network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:48:37 user nova-compute[75215]: WARNING nova.compute.manager [req-135ca277-5810-4e9f-b413-50398272cfbc req-fbce56b1-d876-4eae-b072-5e51ca86746a service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received unexpected event network-vif-plugged-e387612b-0d73-403b-b9b1-8c83fe20429f for instance with vm_state active and task_state deleting.
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-ec13dbc6-5aa6-4f6a-8592-9ddbcdbd68c6 req-c33c70de-f883-4d6b-803b-ae48afecfc9e service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Received event network-vif-deleted-e387612b-0d73-403b-b9b1-8c83fe20429f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:48:37 user nova-compute[75215]: INFO nova.compute.manager [req-ec13dbc6-5aa6-4f6a-8592-9ddbcdbd68c6 req-c33c70de-f883-4d6b-803b-ae48afecfc9e service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Neutron deleted interface e387612b-0d73-403b-b9b1-8c83fe20429f; detaching it from the instance and deleting it from the info cache
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-ec13dbc6-5aa6-4f6a-8592-9ddbcdbd68c6 req-c33c70de-f883-4d6b-803b-ae48afecfc9e service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:37 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Took 1.05 seconds to deallocate network for instance.
Nov 29 14:48:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-ec13dbc6-5aa6-4f6a-8592-9ddbcdbd68c6 req-c33c70de-f883-4d6b-803b-ae48afecfc9e service nova] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Detach interface failed, port_id=e387612b-0d73-403b-b9b1-8c83fe20429f, reason: Instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:48:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:38 user nova-compute[75215]: INFO nova.compute.manager [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Took 1.03 seconds to detach 1 volumes for instance.
Nov 29 14:48:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] [instance: c83d839d-ee08-4c71-b1ce-6b235b33fbbe] Deleting volume: 750c2cb0-00d2-423b-b2ac-4f80811a58e5 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 14:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:39 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:48:39 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:39 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Deleted allocations for instance c83d839d-ee08-4c71-b1ce-6b235b33fbbe
Nov 29 14:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-15197362-c5a4-4892-9d59-03f923d6e691 tempest-ServerActionsV293TestJSON-521197919 tempest-ServerActionsV293TestJSON-521197919-project-member] Lock "c83d839d-ee08-4c71-b1ce-6b235b33fbbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.522s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:48:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:48:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:48:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=24.90753936767578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:49:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 4d412532-27e4-4a63-bea2-818013f2aa30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 706eda24-7f1a-4a11-836f-81777fbee1a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:49:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:49:02 user nova-compute[75215]: INFO nova.compute.claims [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Claim successful on node user
Nov 29 14:49:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:49:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.policy [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc31705a39b4447a3ad96ca8d073144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0dc3e9a4bc447a80d5983bbafe3059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:49:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Creating image(s)
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk 1073741824" returned: 0 in 0.054s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Successfully created port: 2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Cannot resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Ensure instance console log exists: /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Successfully updated port: 2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-changed-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Refreshing instance network info cache due to event network-changed-2e908e58-ac66-489e-b05c-69fcccc1f750. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance network_info: |[{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Refreshing network info cache for port 2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start _get_guest_xml network_info=[{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:49:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:49:05 user nova-compute[75215]:   <uuid>25d981de-63c5-4012-8f38-fca174d1f3f7</uuid>
Nov 29 14:49:05 user nova-compute[75215]:   <name>instance-00000012</name>
Nov 29 14:49:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:49:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:49:05 user nova-compute[75215]:   <metadata>
Nov 29 14:49:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:49:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-612258283</nova:name>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:49:05</nova:creationTime>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:49:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:49:05 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:owner>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:user uuid="bfc31705a39b4447a3ad96ca8d073144">tempest-AttachVolumeTestJSON-1589123637-project-member</nova:user>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:project uuid="7f0dc3e9a4bc447a80d5983bbafe3059">tempest-AttachVolumeTestJSON-1589123637</nova:project>
Nov 29 14:49:05 user nova-compute[75215]:       </nova:owner>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:49:05 user nova-compute[75215]:       <nova:ports>
Nov 29 14:49:05 user nova-compute[75215]:         <nova:port uuid="2e908e58-ac66-489e-b05c-69fcccc1f750">
Nov 29 14:49:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:49:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:49:05 user nova-compute[75215]:       </nova:ports>
Nov 29 14:49:05 user nova-compute[75215]:     </nova:instance>
Nov 29 14:49:05 user nova-compute[75215]:   </metadata>
Nov 29 14:49:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:49:05 user nova-compute[75215]:     <system>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="serial">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="uuid">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:49:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:49:05 user nova-compute[75215]:     </system>
Nov 29 14:49:05 user nova-compute[75215]:   </sysinfo>
Nov 29 14:49:05 user nova-compute[75215]:   <os>
Nov 29 14:49:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:49:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:49:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:49:05 user nova-compute[75215]:   </os>
Nov 29 14:49:05 user nova-compute[75215]:   <features>
Nov 29 14:49:05 user nova-compute[75215]:     <acpi/>
Nov 29 14:49:05 user nova-compute[75215]:     <apic/>
Nov 29 14:49:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:49:05 user nova-compute[75215]:   </features>
Nov 29 14:49:05 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:49:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:49:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:49:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:49:05 user nova-compute[75215]:   </clock>
Nov 29 14:49:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:49:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:49:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:49:05 user nova-compute[75215]:   </cpu>
Nov 29 14:49:05 user nova-compute[75215]:   <devices>
Nov 29 14:49:05 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:05 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:05 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk"/>
Nov 29 14:49:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:49:05 user nova-compute[75215]:     </disk>
Nov 29 14:49:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:49:05 user nova-compute[75215]:       <mac address="fa:16:3e:85:ed:19"/>
Nov 29 14:49:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:49:05 user nova-compute[75215]:       <target dev="tap2e908e58-ac"/>
Nov 29 14:49:05 user nova-compute[75215]:     </interface>
Nov 29 14:49:05 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:49:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/console.log" append="off"/>
Nov 29 14:49:05 user nova-compute[75215]:     </serial>
Nov 29 14:49:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:49:05 user nova-compute[75215]:     <video>
Nov 29 14:49:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:05 user nova-compute[75215]:     </video>
Nov 29 14:49:05 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:49:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:49:05 user nova-compute[75215]:     </rng>
Nov 29 14:49:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:49:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:49:05 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:49:05 user nova-compute[75215]:     </memballoon>
Nov 29 14:49:05 user nova-compute[75215]:   </devices>
Nov 29 14:49:05 user nova-compute[75215]: </domain>
Nov 29 14:49:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG os_vif [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0811feb-cd2f-50e5-8ce8-00b549892c24', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e908e58-ac, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e908e58-ac, col_values=(('qos', UUID('b2eaa98e-81dd-4bf7-852d-e1559ba66191')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e908e58-ac, col_values=(('external_ids', {'iface-id': '2e908e58-ac66-489e-b05c-69fcccc1f750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:ed:19', 'vm-uuid': '25d981de-63c5-4012-8f38-fca174d1f3f7'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:05 user nova-compute[75215]: INFO os_vif [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No VIF found with MAC fa:16:3e:85:ed:19, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updated VIF entry in instance network info cache for port 2e908e58-ac66-489e-b05c-69fcccc1f750. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d788a8a-8894-4054-8b13-29283b9f9df2 req-f6035087-0a35-4434-94cb-965d5de9708a service nova] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:07 user nova-compute[75215]: WARNING nova.compute.manager [req-f9494983-f25a-41ff-b71d-f49b575a7b55 req-7b982244-b1c7-4af6-b3ea-35717d743ca3 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state building and task_state spawning.
Nov 29 14:49:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:49:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance spawned successfully.
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:09 user nova-compute[75215]: INFO nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:09 user nova-compute[75215]: INFO nova.compute.manager [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Took 6.55 seconds to build instance.
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:09 user nova-compute[75215]: WARNING nova.compute.manager [req-15152ce8-3906-44e6-9fae-c2471aece944 req-0c50962c-a2db-4865-a739-75991577c78d service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state None.
Nov 29 14:49:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d7b20bf-8dd5-411b-96d3-90f14eddbcb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:12 user nova-compute[75215]: INFO nova.compute.manager [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Rescuing
Nov 29 14:49:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:49:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:14 user nova-compute[75215]: WARNING nova.compute.manager [req-ab56c14c-864c-4c9e-8196-050aa714f26a req-2f96b0ca-5ae6-4acc-ba33-38e6fa34f26a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state active and task_state rescuing.
Nov 29 14:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance destroyed successfully.
Nov 29 14:49:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Attempting rescue
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:49:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Creating image(s)
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue" returned: 0 in 0.060s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'migration_context' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<8941f1e0-c109-43be-a997-fedcfd1c8e99> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start _get_guest_xml network_info=[{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:54:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<8941f1e0-c109-43be-a997-fedcfd1c8e99> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'numa_topology' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<8941f1e0-c109-43be-a997-fedcfd1c8e99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:49:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<8941f1e0-c109-43be-a997-fedcfd1c8e99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1380020231',display_name='tempest-ServerRescueNegativeTestJSON-server-1380020231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1380020231',id=14,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-9aeuqnxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:31Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=8941f1e0-c109-43be-a997-fedcfd1c8e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:54:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:54:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<8941f1e0-c109-43be-a997-fedcfd1c8e99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:49:15 user nova-compute[75215]:   <uuid>8941f1e0-c109-43be-a997-fedcfd1c8e99</uuid>
Nov 29 14:49:15 user nova-compute[75215]:   <name>instance-0000000e</name>
Nov 29 14:49:15 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:49:15 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:49:15 user nova-compute[75215]:   <metadata>
Nov 29 14:49:15 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:49:15 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1380020231</nova:name>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:49:15</nova:creationTime>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:49:15 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:49:15 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:owner>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:49:15 user nova-compute[75215]:       </nova:owner>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:49:15 user nova-compute[75215]:       <nova:ports>
Nov 29 14:49:15 user nova-compute[75215]:         <nova:port uuid="c6bef3c5-f538-4694-a27a-b633fd02f0f6">
Nov 29 14:49:15 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:49:15 user nova-compute[75215]:         </nova:port>
Nov 29 14:49:15 user nova-compute[75215]:       </nova:ports>
Nov 29 14:49:15 user nova-compute[75215]:     </nova:instance>
Nov 29 14:49:15 user nova-compute[75215]:   </metadata>
Nov 29 14:49:15 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:49:15 user nova-compute[75215]:     <system>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="serial">8941f1e0-c109-43be-a997-fedcfd1c8e99</entry>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="uuid">8941f1e0-c109-43be-a997-fedcfd1c8e99</entry>
Nov 29 14:49:15 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:49:15 user nova-compute[75215]:     </system>
Nov 29 14:49:15 user nova-compute[75215]:   </sysinfo>
Nov 29 14:49:15 user nova-compute[75215]:   <os>
Nov 29 14:49:15 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:49:15 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:49:15 user nova-compute[75215]:   </os>
Nov 29 14:49:15 user nova-compute[75215]:   <features>
Nov 29 14:49:15 user nova-compute[75215]:     <acpi/>
Nov 29 14:49:15 user nova-compute[75215]:     <apic/>
Nov 29 14:49:15 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:49:15 user nova-compute[75215]:   </features>
Nov 29 14:49:15 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:49:15 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:49:15 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:49:15 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:49:15 user nova-compute[75215]:   </clock>
Nov 29 14:49:15 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:49:15 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:49:15 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:49:15 user nova-compute[75215]:   </cpu>
Nov 29 14:49:15 user nova-compute[75215]:   <devices>
Nov 29 14:49:15 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:15 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:15 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue"/>
Nov 29 14:49:15 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:49:15 user nova-compute[75215]:     </disk>
Nov 29 14:49:15 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:15 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:15 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk"/>
Nov 29 14:49:15 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:49:15 user nova-compute[75215]:     </disk>
Nov 29 14:49:15 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:49:15 user nova-compute[75215]:       <mac address="fa:16:3e:54:df:ee"/>
Nov 29 14:49:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:15 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:49:15 user nova-compute[75215]:       <target dev="tapc6bef3c5-f5"/>
Nov 29 14:49:15 user nova-compute[75215]:     </interface>
Nov 29 14:49:15 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:49:15 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/console.log" append="off"/>
Nov 29 14:49:15 user nova-compute[75215]:     </serial>
Nov 29 14:49:15 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:49:15 user nova-compute[75215]:     <video>
Nov 29 14:49:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:15 user nova-compute[75215]:     </video>
Nov 29 14:49:15 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:49:15 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:49:15 user nova-compute[75215]:     </rng>
Nov 29 14:49:15 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:49:15 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:49:15 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:49:15 user nova-compute[75215]:     </memballoon>
Nov 29 14:49:15 user nova-compute[75215]:   </devices>
Nov 29 14:49:15 user nova-compute[75215]: </domain>
Nov 29 14:49:15 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:49:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance destroyed successfully.
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:54:df:ee, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:16 user nova-compute[75215]: WARNING nova.compute.manager [req-e1a57e05-c932-4e25-a45d-e6e0f6b75831 req-6641b545-ad7c-4a3b-a520-d5d8ec13b370 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state active and task_state rescuing.
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:18 user nova-compute[75215]: WARNING nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state active and task_state rescuing.
Nov 29 14:49:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:18 user nova-compute[75215]: WARNING nova.compute.manager [req-c5fcd2bd-ba70-4144-bd66-0d054d980bbd req-18a41c3c-f542-47d6-81e5-0efeff9cbdc9 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state active and task_state rescuing.
Nov 29 14:49:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c3d6a04d-560c-4965-9457-dc44b85f99e7 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:49:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:49:24 user nova-compute[75215]: INFO nova.compute.claims [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Claim successful on node user
Nov 29 14:49:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:49:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:49:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Creating image(s)
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG nova.policy [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25bf6c00d9b340c78b2e136f22b2b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9445b58a3554c19b57afbffbaa6a112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk 1073741824" returned: 0 in 0.085s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Cannot resize image /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Ensure instance console log exists: /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Successfully created port: 804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:49:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Successfully updated port: 804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing instance network info cache due to event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Instance network_info: |[{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Start _get_guest_xml network_info=[{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:49:27 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:27 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911523263',display_name='tempest-ServerActionsTestOtherA-server-911523263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911523263',id=19,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-fw0qotgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:49:27 user nova-compute[75215]:   <uuid>9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3</uuid>
Nov 29 14:49:27 user nova-compute[75215]:   <name>instance-00000013</name>
Nov 29 14:49:27 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:49:27 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:49:27 user nova-compute[75215]:   <metadata>
Nov 29 14:49:27 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:49:27 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-911523263</nova:name>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:49:27</nova:creationTime>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:49:27 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:49:27 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:owner>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:user uuid="25bf6c00d9b340c78b2e136f22b2b211">tempest-ServerActionsTestOtherA-380950315-project-member</nova:user>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:project uuid="f9445b58a3554c19b57afbffbaa6a112">tempest-ServerActionsTestOtherA-380950315</nova:project>
Nov 29 14:49:27 user nova-compute[75215]:       </nova:owner>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:49:27 user nova-compute[75215]:       <nova:ports>
Nov 29 14:49:27 user nova-compute[75215]:         <nova:port uuid="804ac5f2-692e-4630-8e3f-59e788ba0f28">
Nov 29 14:49:27 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 14:49:27 user nova-compute[75215]:         </nova:port>
Nov 29 14:49:27 user nova-compute[75215]:       </nova:ports>
Nov 29 14:49:27 user nova-compute[75215]:     </nova:instance>
Nov 29 14:49:27 user nova-compute[75215]:   </metadata>
Nov 29 14:49:27 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:49:27 user nova-compute[75215]:     <system>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="serial">9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3</entry>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="uuid">9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3</entry>
Nov 29 14:49:27 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:49:27 user nova-compute[75215]:     </system>
Nov 29 14:49:27 user nova-compute[75215]:   </sysinfo>
Nov 29 14:49:27 user nova-compute[75215]:   <os>
Nov 29 14:49:27 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:49:27 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:49:27 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:49:27 user nova-compute[75215]:   </os>
Nov 29 14:49:27 user nova-compute[75215]:   <features>
Nov 29 14:49:27 user nova-compute[75215]:     <acpi/>
Nov 29 14:49:27 user nova-compute[75215]:     <apic/>
Nov 29 14:49:27 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:49:27 user nova-compute[75215]:   </features>
Nov 29 14:49:27 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:49:27 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:49:27 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:49:27 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:49:27 user nova-compute[75215]:   </clock>
Nov 29 14:49:27 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:49:27 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:49:27 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:49:27 user nova-compute[75215]:   </cpu>
Nov 29 14:49:27 user nova-compute[75215]:   <devices>
Nov 29 14:49:27 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:27 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:27 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk"/>
Nov 29 14:49:27 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:49:27 user nova-compute[75215]:     </disk>
Nov 29 14:49:27 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:49:27 user nova-compute[75215]:       <mac address="fa:16:3e:62:12:21"/>
Nov 29 14:49:27 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:27 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:49:27 user nova-compute[75215]:       <target dev="tap804ac5f2-69"/>
Nov 29 14:49:27 user nova-compute[75215]:     </interface>
Nov 29 14:49:27 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:49:27 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/console.log" append="off"/>
Nov 29 14:49:27 user nova-compute[75215]:     </serial>
Nov 29 14:49:27 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:49:27 user nova-compute[75215]:     <video>
Nov 29 14:49:27 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:27 user nova-compute[75215]:     </video>
Nov 29 14:49:27 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:49:27 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:49:27 user nova-compute[75215]:     </rng>
Nov 29 14:49:27 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:49:27 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:49:27 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:49:27 user nova-compute[75215]:     </memballoon>
Nov 29 14:49:27 user nova-compute[75215]:   </devices>
Nov 29 14:49:27 user nova-compute[75215]: </domain>
Nov 29 14:49:27 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911523263',display_name='tempest-ServerActionsTestOtherA-server-911523263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911523263',id=19,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-fw0qotgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG os_vif [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c144247c-a9b4-5d7f-aba9-09330ec2ac83', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804ac5f2-69, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804ac5f2-69, col_values=(('qos', UUID('42e00ed8-6770-42cb-a650-e8917c90600b')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804ac5f2-69, col_values=(('external_ids', {'iface-id': '804ac5f2-692e-4630-8e3f-59e788ba0f28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:12:21', 'vm-uuid': '9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: INFO os_vif [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69')
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:62:12:21, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated VIF entry in instance network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a0794cb-d02a-4731-a3e0-801952b9327a req-b70eecbb-5afd-4e0e-a2f2-a9eb51387e53 service nova] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:49:27 user nova-compute[75215]: INFO nova.compute.claims [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Claim successful on node user
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:49:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.policy [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17839d64f1ee42528d08a7d00cd3159d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2714f996f4404fd5a282aa4866064738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:49:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Creating image(s)
Nov 29 14:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk 1073741824" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.440s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Successfully created port: 9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:49:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Cannot resize image /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Successfully updated port: 9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-changed-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Refreshing instance network info cache due to event network-changed-9c699603-deba-4c85-a935-74136b77ed44. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:49:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance network_info: |[{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Refreshing network info cache for port 9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start _get_guest_xml network_info=[{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:49:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'pci_devices' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:49:31 user nova-compute[75215]:   <uuid>a4d29026-19d4-4558-b8fe-a56b1bb81a1e</uuid>
Nov 29 14:49:31 user nova-compute[75215]:   <name>instance-00000014</name>
Nov 29 14:49:31 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:49:31 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:49:31 user nova-compute[75215]:   <metadata>
Nov 29 14:49:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:49:31 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherB-server-2011968674</nova:name>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:49:31</nova:creationTime>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:49:31 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:49:31 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:owner>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:user uuid="17839d64f1ee42528d08a7d00cd3159d">tempest-ServerActionsTestOtherB-291681319-project-member</nova:user>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:project uuid="2714f996f4404fd5a282aa4866064738">tempest-ServerActionsTestOtherB-291681319</nova:project>
Nov 29 14:49:31 user nova-compute[75215]:       </nova:owner>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:49:31 user nova-compute[75215]:       <nova:ports>
Nov 29 14:49:31 user nova-compute[75215]:         <nova:port uuid="9c699603-deba-4c85-a935-74136b77ed44">
Nov 29 14:49:31 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:49:31 user nova-compute[75215]:         </nova:port>
Nov 29 14:49:31 user nova-compute[75215]:       </nova:ports>
Nov 29 14:49:31 user nova-compute[75215]:     </nova:instance>
Nov 29 14:49:31 user nova-compute[75215]:   </metadata>
Nov 29 14:49:31 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:49:31 user nova-compute[75215]:     <system>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="serial">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="uuid">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:49:31 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:49:31 user nova-compute[75215]:     </system>
Nov 29 14:49:31 user nova-compute[75215]:   </sysinfo>
Nov 29 14:49:31 user nova-compute[75215]:   <os>
Nov 29 14:49:31 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:49:31 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:49:31 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:49:31 user nova-compute[75215]:   </os>
Nov 29 14:49:31 user nova-compute[75215]:   <features>
Nov 29 14:49:31 user nova-compute[75215]:     <acpi/>
Nov 29 14:49:31 user nova-compute[75215]:     <apic/>
Nov 29 14:49:31 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:49:31 user nova-compute[75215]:   </features>
Nov 29 14:49:31 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:49:31 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:49:31 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:49:31 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:49:31 user nova-compute[75215]:   </clock>
Nov 29 14:49:31 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:49:31 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:49:31 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:49:31 user nova-compute[75215]:   </cpu>
Nov 29 14:49:31 user nova-compute[75215]:   <devices>
Nov 29 14:49:31 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:31 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:31 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk"/>
Nov 29 14:49:31 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:49:31 user nova-compute[75215]:     </disk>
Nov 29 14:49:31 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:49:31 user nova-compute[75215]:       <mac address="fa:16:3e:c6:77:67"/>
Nov 29 14:49:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:31 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:49:31 user nova-compute[75215]:       <target dev="tap9c699603-de"/>
Nov 29 14:49:31 user nova-compute[75215]:     </interface>
Nov 29 14:49:31 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:49:31 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/console.log" append="off"/>
Nov 29 14:49:31 user nova-compute[75215]:     </serial>
Nov 29 14:49:31 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:49:31 user nova-compute[75215]:     <video>
Nov 29 14:49:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:31 user nova-compute[75215]:     </video>
Nov 29 14:49:31 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:49:31 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:49:31 user nova-compute[75215]:     </rng>
Nov 29 14:49:31 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:49:31 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:49:31 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:49:31 user nova-compute[75215]:     </memballoon>
Nov 29 14:49:31 user nova-compute[75215]:   </devices>
Nov 29 14:49:31 user nova-compute[75215]: </domain>
Nov 29 14:49:31 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG os_vif [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f15b42b2-f30a-5f39-b9b1-2c58db7b35db', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c699603-de, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c699603-de, col_values=(('qos', UUID('0544ba6d-fcb5-404c-be88-ca20ba899949')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c699603-de, col_values=(('external_ids', {'iface-id': '9c699603-deba-4c85-a935-74136b77ed44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:77:67', 'vm-uuid': 'a4d29026-19d4-4558-b8fe-a56b1bb81a1e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:31 user nova-compute[75215]: INFO os_vif [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No VIF found with MAC fa:16:3e:c6:77:67, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updated VIF entry in instance network info cache for port 9c699603-deba-4c85-a935-74136b77ed44. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Instance spawned successfully.
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce770e77-2fa6-4e0b-a3f8-666a022973ad req-8f2ceb80-4a4f-42eb-81d8-e3ac686893e4 service nova] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:32 user nova-compute[75215]: INFO nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Took 7.28 seconds to spawn the instance on the hypervisor.
Nov 29 14:49:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:49:32 user nova-compute[75215]: INFO nova.compute.manager [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Took 8.28 seconds to build instance.
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e7b28896-4bda-4889-8f24-d7e7138fcdc8 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] No waiting events found dispatching network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:32 user nova-compute[75215]: WARNING nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received unexpected event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 for instance with vm_state active and task_state None.
Nov 29 14:49:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] No waiting events found dispatching network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:32 user nova-compute[75215]: WARNING nova.compute.manager [req-22291e01-8912-467a-897b-c84bf50e92ab req-201a4de3-4d56-4f22-bf29-4c1cfd2f5c04 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received unexpected event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 for instance with vm_state active and task_state None.
Nov 29 14:49:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:33 user nova-compute[75215]: WARNING nova.compute.manager [req-7bf09969-1a2e-49b3-8278-64a4fcaf3c7b req-217adfab-916c-46b7-b44d-f5c3eed2e02e service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state building and task_state spawning.
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:33 user nova-compute[75215]: INFO nova.compute.manager [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Terminating instance
Nov 29 14:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-unplugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] No waiting events found dispatching network-vif-unplugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d2e81439-0be8-4e08-ac55-857466b51e93 req-1a713e99-88c6-4810-b617-f5c7b7caf0fa service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-unplugged-ed760b66-a402-4eb8-acbd-e91d74b29435 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Instance destroyed successfully.
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'resources' on Instance uuid 4d412532-27e4-4a63-bea2-818013f2aa30 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1326020668',display_name='tempest-VolumesAdminNegativeTest-server-1326020668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1326020668',id=15,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-1rd9t22f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:47:44Z,user_data=None,user_id='bd6a80f6b20b43949002e417e3886f88',uuid=4d412532-27e4-4a63-bea2-818013f2aa30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "ed760b66-a402-4eb8-acbd-e91d74b29435", "address": "fa:16:3e:dd:28:11", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped760b66-a4", "ovs_interfaceid": "ed760b66-a402-4eb8-acbd-e91d74b29435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG os_vif [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped760b66-a4, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f082af8e-19c6-48ab-ac24-7562f1b1ceee) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:34 user nova-compute[75215]: INFO os_vif [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:28:11,bridge_name='br-int',has_traffic_filtering=True,id=ed760b66-a402-4eb8-acbd-e91d74b29435,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped760b66-a4')
Nov 29 14:49:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Deleting instance files /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30_del
Nov 29 14:49:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Deletion of /opt/stack/data/nova/instances/4d412532-27e4-4a63-bea2-818013f2aa30_del complete
Nov 29 14:49:34 user nova-compute[75215]: INFO nova.compute.manager [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 29 14:49:34 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:49:34 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:35 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Took 0.70 seconds to deallocate network for instance.
Nov 29 14:49:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-67c69491-6f9e-4f5a-b298-30d84808fc0d req-b6f1dfbf-0aab-490a-b046-b46ecdf90613 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-deleted-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:35 user nova-compute[75215]: WARNING nova.compute.manager [req-d636b137-99ea-4b3d-8d42-4e4193effd0a req-9e5b3b48-ddcc-4504-8fe2-edc9813f00b9 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state building and task_state spawning.
Nov 29 14:49:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:49:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance spawned successfully.
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] Acquiring lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] Lock "4d412532-27e4-4a63-bea2-818013f2aa30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] No waiting events found dispatching network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:36 user nova-compute[75215]: WARNING nova.compute.manager [req-27eb471a-aaa2-4149-a5a4-8a61a70f22c2 req-8c16cf51-4a1d-487d-8dcb-31d9ecbd3271 service nova] [instance: 4d412532-27e4-4a63-bea2-818013f2aa30] Received unexpected event network-vif-plugged-ed760b66-a402-4eb8-acbd-e91d74b29435 for instance with vm_state deleted and task_state None.
Nov 29 14:49:36 user nova-compute[75215]: INFO nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 29 14:49:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:36 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Deleted allocations for instance 4d412532-27e4-4a63-bea2-818013f2aa30
Nov 29 14:49:36 user nova-compute[75215]: INFO nova.compute.manager [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Took 8.75 seconds to build instance.
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-297b6273-e52a-410d-868d-38065e4c151d tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.910s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-45f748c0-b7a3-4f89-907c-cf1295a15588 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "4d412532-27e4-4a63-bea2-818013f2aa30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:49:41 user nova-compute[75215]: INFO nova.compute.claims [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Claim successful on node user
Nov 29 14:49:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:49:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.policy [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fad9c93f4ea491880e3cd7a97518367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72c331f6f384976bc971f9318b7d0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:49:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Creating image(s)
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Successfully created port: ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk 1073741824" returned: 0 in 0.069s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Cannot resize image /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Successfully updated port: ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-changed-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Refreshing instance network info cache due to event network-changed-ac720b02-bd95-40c9-b25d-55720ee908aa. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] Acquiring lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Instance network_info: |[{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] Acquired lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Refreshing network info cache for port ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Start _get_guest_xml network_info=[{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:49:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-390707395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-390707395',id=21,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-agwuj6u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:42Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=d4c065a7-3c11-430a-b5dc-75869210d0a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c065a7-3c11-430a-b5dc-75869210d0a9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:49:43 user nova-compute[75215]:   <uuid>d4c065a7-3c11-430a-b5dc-75869210d0a9</uuid>
Nov 29 14:49:43 user nova-compute[75215]:   <name>instance-00000015</name>
Nov 29 14:49:43 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:49:43 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:49:43 user nova-compute[75215]:   <metadata>
Nov 29 14:49:43 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:49:43 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-390707395</nova:name>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:49:43</nova:creationTime>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:49:43 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:49:43 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:owner>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 14:49:43 user nova-compute[75215]:       </nova:owner>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:49:43 user nova-compute[75215]:       <nova:ports>
Nov 29 14:49:43 user nova-compute[75215]:         <nova:port uuid="ac720b02-bd95-40c9-b25d-55720ee908aa">
Nov 29 14:49:43 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:49:43 user nova-compute[75215]:         </nova:port>
Nov 29 14:49:43 user nova-compute[75215]:       </nova:ports>
Nov 29 14:49:43 user nova-compute[75215]:     </nova:instance>
Nov 29 14:49:43 user nova-compute[75215]:   </metadata>
Nov 29 14:49:43 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:49:43 user nova-compute[75215]:     <system>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="serial">d4c065a7-3c11-430a-b5dc-75869210d0a9</entry>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="uuid">d4c065a7-3c11-430a-b5dc-75869210d0a9</entry>
Nov 29 14:49:43 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:49:43 user nova-compute[75215]:     </system>
Nov 29 14:49:43 user nova-compute[75215]:   </sysinfo>
Nov 29 14:49:43 user nova-compute[75215]:   <os>
Nov 29 14:49:43 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:49:43 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:49:43 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:49:43 user nova-compute[75215]:   </os>
Nov 29 14:49:43 user nova-compute[75215]:   <features>
Nov 29 14:49:43 user nova-compute[75215]:     <acpi/>
Nov 29 14:49:43 user nova-compute[75215]:     <apic/>
Nov 29 14:49:43 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:49:43 user nova-compute[75215]:   </features>
Nov 29 14:49:43 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:49:43 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:49:43 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:49:43 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:49:43 user nova-compute[75215]:   </clock>
Nov 29 14:49:43 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:49:43 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:49:43 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:49:43 user nova-compute[75215]:   </cpu>
Nov 29 14:49:43 user nova-compute[75215]:   <devices>
Nov 29 14:49:43 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:49:43 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:49:43 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk"/>
Nov 29 14:49:43 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:49:43 user nova-compute[75215]:     </disk>
Nov 29 14:49:43 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:49:43 user nova-compute[75215]:       <mac address="fa:16:3e:a0:b0:2d"/>
Nov 29 14:49:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:43 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:49:43 user nova-compute[75215]:       <target dev="tapac720b02-bd"/>
Nov 29 14:49:43 user nova-compute[75215]:     </interface>
Nov 29 14:49:43 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:49:43 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/console.log" append="off"/>
Nov 29 14:49:43 user nova-compute[75215]:     </serial>
Nov 29 14:49:43 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:49:43 user nova-compute[75215]:     <video>
Nov 29 14:49:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:49:43 user nova-compute[75215]:     </video>
Nov 29 14:49:43 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:49:43 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:49:43 user nova-compute[75215]:     </rng>
Nov 29 14:49:43 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:49:43 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:49:43 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:49:43 user nova-compute[75215]:     </memballoon>
Nov 29 14:49:43 user nova-compute[75215]:   </devices>
Nov 29 14:49:43 user nova-compute[75215]: </domain>
Nov 29 14:49:43 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-390707395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-390707395',id=21,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-agwuj6u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:49:42Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=d4c065a7-3c11-430a-b5dc-75869210d0a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG os_vif [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33e745c2-974e-565d-8dfe-99d1d80f7441', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac720b02-bd, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac720b02-bd, col_values=(('qos', UUID('8031be95-ce80-4f10-8a6d-5109f4dde7fa')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac720b02-bd, col_values=(('external_ids', {'iface-id': 'ac720b02-bd95-40c9-b25d-55720ee908aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:2d', 'vm-uuid': 'd4c065a7-3c11-430a-b5dc-75869210d0a9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:49:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:43 user nova-compute[75215]: INFO os_vif [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd')
Nov 29 14:49:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:a0:b0:2d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updated VIF entry in instance network info cache for port ac720b02-bd95-40c9-b25d-55720ee908aa. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:49:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37671812-3bb5-4f3b-b0d5-75098377144d req-9434a121-a204-419b-a06e-d4d34c494177 service nova] Releasing lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] No waiting events found dispatching network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:45 user nova-compute[75215]: WARNING nova.compute.manager [req-ae3dd3ac-bc39-42b0-b1fe-51e1e56ea318 req-1b303871-511c-41af-b1f5-1bd3519ef0b3 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received unexpected event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa for instance with vm_state building and task_state spawning.
Nov 29 14:49:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:49:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] No waiting events found dispatching network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:49:47 user nova-compute[75215]: WARNING nova.compute.manager [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received unexpected event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa for instance with vm_state building and task_state spawning.
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing instance network info cache due to event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Acquiring lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Acquired lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing network info cache for port ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:49:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Instance spawned successfully.
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:48 user nova-compute[75215]: INFO nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 29 14:49:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:49:48 user nova-compute[75215]: INFO nova.compute.manager [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Took 6.73 seconds to build instance.
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c256b73d-be3e-4dac-8b08-9f0f245358da tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.941s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:48 user nova-compute[75215]: INFO nova.compute.manager [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Attaching volume 13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 to /dev/vdb
Nov 29 14:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updated VIF entry in instance network info cache for port ce19f3e2-1caa-4a09-8027-3947a5a0209d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating instance_info_cache with network_info: [{"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-21a76875-f86c-44c4-bac2-a1b8c0e1051c req-b4915914-98f7-4874-89c5-076d8d4b2718 service nova] Releasing lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1e256-9ef8-4f99-abbc-8e242c74458c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9004321-4840-4c63-a855-e46110f0953a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e24b700-a9de-446f-885f-0ef76e2cfee9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86671dc-da8a-40cb-80f4-d0c3cef3c1df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:49:48 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:49:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3cc65e-efdd-4b28-9a1f-f1e0eca1f348]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating existing volume attachment record: 4fdb454e-7174-4a1d-b131-627922d9f808 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:50 user nova-compute[75215]: INFO nova.compute.manager [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Detaching volume 071b175e-acc2-4f2e-ba01-4182dbd5126b
Nov 29 14:49:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Attempting to driver detach volume 071b175e-acc2-4f2e-ba01-4182dbd5126b from mountpoint /dev/vdc
Nov 29 14:49:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Attempting to detach device vdc from instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:49:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:49:50 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 29 14:49:50 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 14:49:50 user nova-compute[75215]:   <serial>071b175e-acc2-4f2e-ba01-4182dbd5126b</serial>
Nov 29 14:49:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:49:50 user nova-compute[75215]: </disk>
Nov 29 14:49:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:49:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully detached device vdc from instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 from the persistent domain config.
Nov 29 14:49:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:49:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:49:50 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 29 14:49:50 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 14:49:50 user nova-compute[75215]:   <serial>071b175e-acc2-4f2e-ba01-4182dbd5126b</serial>
Nov 29 14:49:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:49:50 user nova-compute[75215]: </disk>
Nov 29 14:49:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:49:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating instance_info_cache with network_info: [{"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-d170452a-01be-41dc-ae3e-3950ace74907" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.403s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtQpAiDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:49:58 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:49:58 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:49:58 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dab292f-de21-4480-b1e0-c9ba6f3a5f5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:49:58 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[128129a3-090c-4e91-b2bb-b5c4e2261e09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8] added
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[539e6e6e-5206-4722-a5de-1a60e6bd6e45]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62e3e65-82e1-43f6-a824-c648e0937670]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtQpAiDh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtQpAiDh" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46e5868-378d-4120-ba5a-419db3db79a5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtQpAiDh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15390e33-a19d-4ff6-9d5b-127cbee25ef5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d28183-81ce-4a74-890e-963bd6b91479]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f9dc6-328b-4934-85e5-c672c3b40974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260]
Nov 29 14:49:58 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260] successful.
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9f95bc-c6f2-4cb3-9ddf-2438fc9bb4f0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7bef7-61f7-440b-8693-61e2c44be378]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:49:58 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:49:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b86055-4734-4607-a3ae-28e1c9a8fa76]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtQpAiDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23261346436373161', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261346436373161', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:49:59 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:49:59 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:49:59 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:49:59 user nova-compute[75215]:   <serial>13dd1bde-7d8b-4896-b2f2-01bdb38b36a8</serial>
Nov 29 14:49:59 user nova-compute[75215]: </disk>
Nov 29 14:49:59 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] No VIF found with MAC fa:16:3e:38:4a:db, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:49:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-db02d787-2e28-4242-aa13-adfcf5e977bb tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.951s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:00 user nova-compute[75215]: INFO nova.compute.manager [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Detaching volume 53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:00 user nova-compute[75215]: INFO nova.virt.block_device [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Attempting to driver detach volume 53a5945d-da7d-48c9-b153-843e08352fdf from mountpoint /dev/vdb
Nov 29 14:50:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Attempting to detach device vdb from instance d170452a-01be-41dc-ae3e-3950ace74907 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:00 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:00 user nova-compute[75215]:   <source dev="/dev/sdk"/>
Nov 29 14:50:00 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:00 user nova-compute[75215]:   <serial>53a5945d-da7d-48c9-b153-843e08352fdf</serial>
Nov 29 14:50:00 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:00 user nova-compute[75215]: </disk>
Nov 29 14:50:00 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Successfully detached device vdb from instance d170452a-01be-41dc-ae3e-3950ace74907 from the persistent domain config.
Nov 29 14:50:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d170452a-01be-41dc-ae3e-3950ace74907 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:00 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:00 user nova-compute[75215]:   <source dev="/dev/sdk"/>
Nov 29 14:50:00 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:00 user nova-compute[75215]:   <serial>53a5945d-da7d-48c9-b153-843e08352fdf</serial>
Nov 29 14:50:00 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:00 user nova-compute[75215]: </disk>
Nov 29 14:50:00 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:02 user nova-compute[75215]: INFO nova.compute.manager [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Detaching volume 13dd1bde-7d8b-4896-b2f2-01bdb38b36a8
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:02 user nova-compute[75215]: INFO nova.virt.block_device [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Attempting to driver detach volume 13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 from mountpoint /dev/vdb
Nov 29 14:50:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Attempting to detach device vdb from instance 706eda24-7f1a-4a11-836f-81777fbee1a1 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:02 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:02 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:50:02 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:02 user nova-compute[75215]:   <serial>13dd1bde-7d8b-4896-b2f2-01bdb38b36a8</serial>
Nov 29 14:50:02 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:02 user nova-compute[75215]: </disk>
Nov 29 14:50:02 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully detached device vdb from instance 706eda24-7f1a-4a11-836f-81777fbee1a1 from the persistent domain config.
Nov 29 14:50:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 706eda24-7f1a-4a11-836f-81777fbee1a1 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:02 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:02 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:50:02 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:02 user nova-compute[75215]:   <serial>13dd1bde-7d8b-4896-b2f2-01bdb38b36a8</serial>
Nov 29 14:50:02 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:02 user nova-compute[75215]: </disk>
Nov 29 14:50:02 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:50:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:50:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=6916MB free_disk=24.83377456665039GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:03 user nova-compute[75215]: INFO nova.compute.manager [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Unrescuing
Nov 29 14:50:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 003296b4-4960-4814-b48c-ddd133e060a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d170452a-01be-41dc-ae3e-3950ace74907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 706eda24-7f1a-4a11-836f-81777fbee1a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'flavor' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-changed-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing instance network info cache due to event network-changed-53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing network info cache for port 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:05 user nova-compute[75215]: WARNING nova.compute.manager [req-a4352596-1e65-45ae-a275-43964126a876 req-e47e1c7b-d18b-43d6-aa70-e20f14967c75 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updated VIF entry in instance network info cache for port 53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c734c815-f68f-432b-90b4-f56af3b599e8 req-54c86bc0-652b-4da4-8b45-bf2e403b9ac7 service nova] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance destroyed successfully.
Nov 29 14:50:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-changed-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing instance network info cache due to event network-changed-53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] Acquiring lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] Acquired lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Refreshing network info cache for port 53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid d4c065a7-3c11-430a-b5dc-75869210d0a9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: INFO nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:07 user nova-compute[75215]: WARNING nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:07 user nova-compute[75215]: WARNING nova.compute.manager [req-9b128f4a-be77-4562-b7f5-4201212e5438 req-671ea64c-74e9-4aae-92db-41b4ca13c47f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updated VIF entry in instance network info cache for port 53921259-ca48-418b-959d-c373a73a6807. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [{"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-97fdea62-7fc1-4328-bfbe-3e900dc13ce8 req-8377a1a0-1e19-4ed9-bad2-1ed89de3df8e service nova] Releasing lock "refresh_cache-fae0e81c-9fcc-4a56-a9eb-876c830820b2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-033d6213-4421-432d-bf9b-27e71a1a46a2 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:09 user nova-compute[75215]: WARNING nova.compute.manager [req-95ca6e71-62bd-4a5b-bd60-c99b2c9c27cd req-a96003fe-1359-4a09-b491-f6c8ab1dded5 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state active and task_state None.
Nov 29 14:50:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 is timed out.
Nov 29 14:50:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully detached device vdc from instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 from the live domain config.
Nov 29 14:50:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBkmsbAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90acca-2c74-4bd5-b027-e38d897b12ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:50:10 user nova-compute[75215]: No targets found.
Nov 29 14:50:10 user nova-compute[75215]: iSNS:
Nov 29 14:50:10 user nova-compute[75215]: No targets found.
Nov 29 14:50:10 user nova-compute[75215]: STATIC:
Nov 29 14:50:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8
Nov 29 14:50:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:50:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b
Nov 29 14:50:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:50:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:10 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:10 user nova-compute[75215]: FIRMWARE:
Nov 29 14:50:10 user nova-compute[75215]: No targets found.
Nov 29 14:50:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:50:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:50:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f12b9f-14c9-467e-8154-23df7ddff93e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a997c93-ff3a-4579-91ab-b860ccbf0d62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b (non-flash)
Nov 29 14:50:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cc73c27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175f031-8961-46a0-b1b1-0bb8527d7227]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3030339-936a-4767-8786-32e53a809d28]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef547a-0539-43f7-ab3a-e7f63a5b39a1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd3a4f-5d87-48ea-affb-51546693b1cf]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e38e5c4-ef9e-4d61-a786-dad4e93de491]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666d8d6-de74-4181-930a-a4e840e6f1e3]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260]
Nov 29 14:50:11 user nova-compute[75215]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b, portal: 172.16.0.220,3260] successful.
Nov 29 14:50:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071b175e-acc2-4f2e-ba01-4182dbd5126b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662112e-774d-41b7-a8b1-13b4decf52e2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] <== disconnect_volume: return (360ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:50:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'flavor' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb5ad271-a943-4f41-a914-d1aa5b3c6fb3 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.370s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received event network-changed-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Refreshing instance network info cache due to event network-changed-a8343a72-9a9d-41cb-a5ee-23858483aae3. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] Acquiring lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] Acquired lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Refreshing network info cache for port a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updated VIF entry in instance network info cache for port a8343a72-9a9d-41cb-a5ee-23858483aae3. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:50:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updating instance_info_cache with network_info: [{"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dd7893f0-43b2-4ce1-bc88-4ea1ef06a029 req-f8280bae-0bd7-41d2-8bf2-abfa487dabc2 service nova] Releasing lock "refresh_cache-5ce57ec1-587f-4d44-bce2-46cc4b4554ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d170452a-01be-41dc-ae3e-3950ace74907 is timed out.
Nov 29 14:50:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Successfully detached device vdb from instance d170452a-01be-41dc-ae3e-3950ace74907 from the live domain config.
Nov 29 14:50:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrgUefVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:21 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e9b1d-ccae-4314-a68a-5d76a739f55b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:50:21 user nova-compute[75215]: No targets found.
Nov 29 14:50:21 user nova-compute[75215]: iSNS:
Nov 29 14:50:21 user nova-compute[75215]: No targets found.
Nov 29 14:50:21 user nova-compute[75215]: STATIC:
Nov 29 14:50:21 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8
Nov 29 14:50:21 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:21 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:21 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:50:21 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:21 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:21 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf
Nov 29 14:50:21 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:21 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:21 user nova-compute[75215]: FIRMWARE:
Nov 29 14:50:21 user nova-compute[75215]: No targets found.
Nov 29 14:50:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:50:21 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:50:21 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4652e9-720f-4eb8-9fed-58903f341ac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3535ca0e-5e89-49df-b18e-99d522c7d079]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:50:21 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:21 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf (non-flash)
Nov 29 14:50:21 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:21 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac613a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf'): ({'sdk'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Removing single pathed devices sdk {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e64548-92d0-4586-a7aa-f5c19277aa26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30662b0c-b51b-4155-9869-1807771b0988]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Flushing IO for device /dev/sdk {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaf4c4f-1fc2-473a-b912-b775ca5a4b34]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76371f1-0c15-4c20-adbe-3b687d1621ed]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] SCSI volumes sdk have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a440c4d9-45c9-47d5-9de6-90df8d8d017c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc57f6eb-5893-4cc3-914c-8ff3f1805a39]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260]
Nov 29 14:50:21 user nova-compute[75215]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf, portal: 172.16.0.220,3260] successful.
Nov 29 14:50:21 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a5945d-da7d-48c9-b153-843e08352fdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ecef1-0102-4b6f-bd11-42fffb3daeb8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] <== disconnect_volume: return (330ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lazy-loading 'flavor' on Instance uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:22 user nova-compute[75215]: INFO nova.compute.manager [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Attaching volume 3a3a4773-06d5-48c7-898e-589e60293bb1 to /dev/vdb
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a653a149-63d9-4feb-baf9-6239ced0bfbf tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.452s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.386s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.utils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafd85c-7620-4090-b90d-652bdbf03739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f5ef27-72e4-4c82-ad8c-d72cd7723945]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c143e0-fff1-4a0b-a8fd-b57d841958de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc94c8d-82da-47c8-9d10-360ac6fbab67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:50:23 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8975356-6cb2-4979-bff2-c5d15c062afa]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.utils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updating existing volume attachment record: a77e2011-d8a7-4bd0-9e74-f7ef4625b057 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:50:23 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 706eda24-7f1a-4a11-836f-81777fbee1a1 is timed out.
Nov 29 14:50:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully detached device vdb from instance 706eda24-7f1a-4a11-836f-81777fbee1a1 from the live domain config.
Nov 29 14:50:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtQpAiDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:23 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e6d80-07a8-4330-8dcf-820ef24b1523]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:50:23 user nova-compute[75215]: No targets found.
Nov 29 14:50:23 user nova-compute[75215]: iSNS:
Nov 29 14:50:23 user nova-compute[75215]: No targets found.
Nov 29 14:50:23 user nova-compute[75215]: STATIC:
Nov 29 14:50:23 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8
Nov 29 14:50:23 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:23 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:23 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:50:23 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:23 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:23 user nova-compute[75215]: FIRMWARE:
Nov 29 14:50:23 user nova-compute[75215]: No targets found.
Nov 29 14:50:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:50:23 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:50:23 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4a075-7a57-4168-9b21-9169f035b4d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17d839-5d78-4714-b249-129f1d7837eb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:23 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:23 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 (non-flash)
Nov 29 14:50:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac3e6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1751d5a4-97dd-4f1b-b708-3342024923d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7b459-ddc0-44b3-abb2-f489e81e1fbb]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa59b8b-6833-40e9-9f88-c4a4f3cf5a5f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e0c9af-83bc-4741-bd25-8c6ba98dc024]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47d361-9b9c-4e17-9928-532362feab82]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63257a-38b9-4fdc-8ad1-06233f805cf0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260]
Nov 29 14:50:23 user nova-compute[75215]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8, portal: 172.16.0.220,3260] successful.
Nov 29 14:50:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dd1bde-7d8b-4896-b2f2-01bdb38b36a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a89b9-5054-4075-ab4c-77f856f1dc59]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] <== disconnect_volume: return (322ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:50:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'flavor' on Instance uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50190628-e007-4881-b5c0-354b6f046a26 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.518s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.464s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlFnfKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:30 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c75550-7751-425b-9c50-ff6200b39277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:50:30 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdacf78-c4f3-4b0a-882c-e351ee0320bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1] added
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d48bf0-3974-48dc-8b24-d40b36e0b563]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed34e1-7a32-42cf-828c-1426721a6602]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlFnfKmE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlFnfKmE" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef53897-1328-41ca-bc7e-66465b29d917]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hlFnfKmE'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa39d44-7507-4b4c-a961-e0453b0316d4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:30 user nova-compute[75215]: INFO nova.compute.manager [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Terminating instance
Nov 29 14:50:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b5ec0-416c-4dc6-b967-5bf86dadea68]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a7c5fb-6d26-4584-b029-da77d2752568]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260]
Nov 29 14:50:30 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260] successful.
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358fffc-90e9-48ec-a703-7a2f46fe8742]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83813147-4869-4ccd-90ae-3e6fbb762796]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:30 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:30 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:50:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d62ec7a-4861-4e19-b87a-f2e7f3ac02f0]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-unplugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] No waiting events found dispatching network-vif-unplugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a1623e5-c955-41ec-8a3b-62a80cef3870 req-051ee713-fb4a-4869-a59c-5b8a7784b411 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-unplugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Instance destroyed successfully.
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lazy-loading 'resources' on Instance uuid 003296b4-4960-4814-b48c-ddd133e060a8 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2140701016',display_name='tempest-VolumesAdminNegativeTest-server-2140701016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2140701016',id=5,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu6Rkn0fOMguWoM0JOdq4EH0Dtw6qd488wFZGYanT5f4X2AWVWl9vwxwYWfasvnUIPc6BFHx+wvro3IgzpHm3Opdiy74F38X51OrpLpk85HtcMgEahH80tVSkU7dd0/eg==',key_name='tempest-keypair-2139855903',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aecaaf624add446fafb9e263a766959e',ramdisk_id='',reservation_id='r-za54q81g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-131765768',owner_user_name='tempest-VolumesAdminNegativeTest-131765768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd6a80f6b20b43949002e417e3886f88',uuid=003296b4-4960-4814-b48c-ddd133e060a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converting VIF {"id": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "address": "fa:16:3e:e7:b6:2e", "network": {"id": "471cd579-e503-4478-ac8a-665b2af60a4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2089723315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aecaaf624add446fafb9e263a766959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8e0a5d-3e", "ovs_interfaceid": "de8e0a5d-3e5e-4cdc-bba3-fe912260f0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG os_vif [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde8e0a5d-3e, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5d9acc4-bebb-4ca6-a333-ccf847c6b8b9) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:31 user nova-compute[75215]: INFO os_vif [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b6:2e,bridge_name='br-int',has_traffic_filtering=True,id=de8e0a5d-3e5e-4cdc-bba3-fe912260f0df,network=Network(471cd579-e503-4478-ac8a-665b2af60a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8e0a5d-3e')
Nov 29 14:50:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Deleting instance files /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8_del
Nov 29 14:50:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Deletion of /opt/stack/data/nova/instances/003296b4-4960-4814-b48c-ddd133e060a8_del complete
Nov 29 14:50:31 user nova-compute[75215]: INFO nova.compute.manager [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 14:50:31 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:50:31 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlFnfKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26534613164356633', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534613164356633', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:50:32 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:32 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:50:32 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:32 user nova-compute[75215]:   <serial>3a3a4773-06d5-48c7-898e-589e60293bb1</serial>
Nov 29 14:50:32 user nova-compute[75215]: </disk>
Nov 29 14:50:32 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:24:d8:c5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edb04b86-4697-4a11-9675-4aa9d033fa32 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.753s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:32 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Took 1.13 seconds to deallocate network for instance.
Nov 29 14:50:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] Acquiring lock "003296b4-4960-4814-b48c-ddd133e060a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] Lock "003296b4-4960-4814-b48c-ddd133e060a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] No waiting events found dispatching network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:33 user nova-compute[75215]: WARNING nova.compute.manager [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received unexpected event network-vif-plugged-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df for instance with vm_state deleted and task_state None.
Nov 29 14:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-0819e7a7-3011-4acc-9670-732f2e4bd035 req-1af80e25-edb7-475c-b946-1683d630bc38 service nova] [instance: 003296b4-4960-4814-b48c-ddd133e060a8] Received event network-vif-deleted-de8e0a5d-3e5e-4cdc-bba3-fe912260f0df {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:33 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Deleted allocations for instance 003296b4-4960-4814-b48c-ddd133e060a8
Nov 29 14:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-23237c09-0176-4c5a-af4f-62597f82fc91 tempest-VolumesAdminNegativeTest-131765768 tempest-VolumesAdminNegativeTest-131765768-project-member] Lock "003296b4-4960-4814-b48c-ddd133e060a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.624s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:50:36 user nova-compute[75215]: INFO nova.compute.claims [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Claim successful on node user
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:37 user nova-compute[75215]: INFO nova.compute.manager [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Detaching volume ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:50:37 user nova-compute[75215]: INFO nova.virt.block_device [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Attempting to driver detach volume ce68cdba-83fd-46cd-8f87-58e082a648db from mountpoint /dev/vdb
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Attempting to detach device vdb from instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:37 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:37 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:50:37 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:37 user nova-compute[75215]:   <serial>ce68cdba-83fd-46cd-8f87-58e082a648db</serial>
Nov 29 14:50:37 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:37 user nova-compute[75215]: </disk>
Nov 29 14:50:37 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Successfully detached device vdb from instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 from the persistent domain config.
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:50:37 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:50:37 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:50:37 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:50:37 user nova-compute[75215]:   <serial>ce68cdba-83fd-46cd-8f87-58e082a648db</serial>
Nov 29 14:50:37 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:50:37 user nova-compute[75215]: </disk>
Nov 29 14:50:37 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:50:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.policy [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd88477198b5d411f9e193afdb9f40e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e6a6477d6b4664a2f0de1b0bdc15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:50:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Creating image(s)
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Cannot resize image /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Ensure instance console log exists: /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Successfully created port: 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Successfully updated port: 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquired lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-changed-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Refreshing instance network info cache due to event network-changed-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] Acquiring lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updating instance_info_cache with network_info: [{"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Releasing lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Instance network_info: |[{"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] Acquired lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Refreshing network info cache for port 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Start _get_guest_xml network_info=[{"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:50:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:50:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835544930',display_name='tempest-AttachVolumeNegativeTest-server-835544930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835544930',id=22,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPtKmSPCpfmsjQ1b/MIUtwNkpXhYJTpfKs4Tnx9k1Vl0GqKiO0DdP+eFCt1FLekBOAREStbgNVKQ6MzkjCsXpjL5vF8vwBN+pPOcdYycI//TagCfgg3oXqo76eKPMjzng==',key_name='tempest-keypair-1122932569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7tr0500m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=ca8bbeda-c444-438b-9099-55a9b12ab00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'pci_devices' on Instance uuid ca8bbeda-c444-438b-9099-55a9b12ab00f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:50:39 user nova-compute[75215]:   <uuid>ca8bbeda-c444-438b-9099-55a9b12ab00f</uuid>
Nov 29 14:50:39 user nova-compute[75215]:   <name>instance-00000016</name>
Nov 29 14:50:39 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:50:39 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:50:39 user nova-compute[75215]:   <metadata>
Nov 29 14:50:39 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:50:39 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-835544930</nova:name>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:50:39</nova:creationTime>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:50:39 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:50:39 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:owner>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:user uuid="d88477198b5d411f9e193afdb9f40e03">tempest-AttachVolumeNegativeTest-1682890616-project-member</nova:user>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:project uuid="35e6a6477d6b4664a2f0de1b0bdc15e2">tempest-AttachVolumeNegativeTest-1682890616</nova:project>
Nov 29 14:50:39 user nova-compute[75215]:       </nova:owner>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:50:39 user nova-compute[75215]:       <nova:ports>
Nov 29 14:50:39 user nova-compute[75215]:         <nova:port uuid="820f27ff-f8e9-4adc-9f10-1e5c0152bc3f">
Nov 29 14:50:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 14:50:39 user nova-compute[75215]:         </nova:port>
Nov 29 14:50:39 user nova-compute[75215]:       </nova:ports>
Nov 29 14:50:39 user nova-compute[75215]:     </nova:instance>
Nov 29 14:50:39 user nova-compute[75215]:   </metadata>
Nov 29 14:50:39 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:50:39 user nova-compute[75215]:     <system>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="serial">ca8bbeda-c444-438b-9099-55a9b12ab00f</entry>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="uuid">ca8bbeda-c444-438b-9099-55a9b12ab00f</entry>
Nov 29 14:50:39 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:50:39 user nova-compute[75215]:     </system>
Nov 29 14:50:39 user nova-compute[75215]:   </sysinfo>
Nov 29 14:50:39 user nova-compute[75215]:   <os>
Nov 29 14:50:39 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:50:39 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:50:39 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:50:39 user nova-compute[75215]:   </os>
Nov 29 14:50:39 user nova-compute[75215]:   <features>
Nov 29 14:50:39 user nova-compute[75215]:     <acpi/>
Nov 29 14:50:39 user nova-compute[75215]:     <apic/>
Nov 29 14:50:39 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:50:39 user nova-compute[75215]:   </features>
Nov 29 14:50:39 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:50:39 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:50:39 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:50:39 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:50:39 user nova-compute[75215]:   </clock>
Nov 29 14:50:39 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:50:39 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:50:39 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:50:39 user nova-compute[75215]:   </cpu>
Nov 29 14:50:39 user nova-compute[75215]:   <devices>
Nov 29 14:50:39 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:50:39 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:50:39 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk"/>
Nov 29 14:50:39 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:50:39 user nova-compute[75215]:     </disk>
Nov 29 14:50:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:50:39 user nova-compute[75215]:       <mac address="fa:16:3e:18:16:c1"/>
Nov 29 14:50:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:50:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:50:39 user nova-compute[75215]:       <target dev="tap820f27ff-f8"/>
Nov 29 14:50:39 user nova-compute[75215]:     </interface>
Nov 29 14:50:39 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:50:39 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/console.log" append="off"/>
Nov 29 14:50:39 user nova-compute[75215]:     </serial>
Nov 29 14:50:39 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:50:39 user nova-compute[75215]:     <video>
Nov 29 14:50:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:50:39 user nova-compute[75215]:     </video>
Nov 29 14:50:39 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:50:39 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:50:39 user nova-compute[75215]:     </rng>
Nov 29 14:50:39 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:50:39 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:50:39 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:50:39 user nova-compute[75215]:     </memballoon>
Nov 29 14:50:39 user nova-compute[75215]:   </devices>
Nov 29 14:50:39 user nova-compute[75215]: </domain>
Nov 29 14:50:39 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835544930',display_name='tempest-AttachVolumeNegativeTest-server-835544930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835544930',id=22,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPtKmSPCpfmsjQ1b/MIUtwNkpXhYJTpfKs4Tnx9k1Vl0GqKiO0DdP+eFCt1FLekBOAREStbgNVKQ6MzkjCsXpjL5vF8vwBN+pPOcdYycI//TagCfgg3oXqo76eKPMjzng==',key_name='tempest-keypair-1122932569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7tr0500m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=ca8bbeda-c444-438b-9099-55a9b12ab00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG os_vif [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0b48140-e3ed-5f1c-b856-180b0a8ca1ed', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap820f27ff-f8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap820f27ff-f8, col_values=(('qos', UUID('fd436913-8e3d-424a-b5cc-6dfaa15a69c4')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap820f27ff-f8, col_values=(('external_ids', {'iface-id': '820f27ff-f8e9-4adc-9f10-1e5c0152bc3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:16:c1', 'vm-uuid': 'ca8bbeda-c444-438b-9099-55a9b12ab00f'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:39 user nova-compute[75215]: INFO os_vif [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8')
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:50:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:18:16:c1, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updated VIF entry in instance network info cache for port 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updating instance_info_cache with network_info: [{"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27bbb289-03ca-49e6-b62a-01595d813927 req-7c8d716f-1de6-40c4-95e5-be9136fab08c service nova] Releasing lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:40 user nova-compute[75215]: INFO nova.compute.manager [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Terminating instance
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-11240f82-d390-4d80-89dc-f92bf1cd2d7f req-9b479be7-0df8-42b3-9aaa-0a6cb98d43ca service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-unplugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:50:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Instance destroyed successfully.
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'resources' on Instance uuid ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-720794654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-720794654',id=2,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwGaC1Nm9K34x9cPtaxop9xRNSgbiSQga98YJy4h636DPnKHt1Ja6uM+uXVIHV7NLv6Xoqq3YEC/jfus7jhkEve70FWsW27cfmacVN1w96sco8bHSttiv3DoNI3qLVNiQ==',key_name='tempest-keypair-786004936',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-iiyeuf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "115a6cca-db08-49e7-9978-7b78f2fbf532", "address": "fa:16:3e:3e:8a:97", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115a6cca-db", "ovs_interfaceid": "115a6cca-db08-49e7-9978-7b78f2fbf532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG os_vif [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap115a6cca-db, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04923174-cc16-43e1-ba31-b9656d532cf8) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: INFO os_vif [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8a:97,bridge_name='br-int',has_traffic_filtering=True,id=115a6cca-db08-49e7-9978-7b78f2fbf532,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115a6cca-db')
Nov 29 14:50:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Deleting instance files /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9_del
Nov 29 14:50:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Deletion of /opt/stack/data/nova/instances/ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9_del complete
Nov 29 14:50:41 user nova-compute[75215]: INFO nova.compute.manager [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 14:50:41 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] No waiting events found dispatching network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:41 user nova-compute[75215]: WARNING nova.compute.manager [req-fbd3406f-80ce-4345-b0df-700bcc5378fc req-83d8771d-c799-4478-951b-96727abeae19 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received unexpected event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f for instance with vm_state building and task_state spawning.
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:42 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Took 0.93 seconds to deallocate network for instance.
Nov 29 14:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] Acquiring lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] No waiting events found dispatching network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:42 user nova-compute[75215]: WARNING nova.compute.manager [req-5d5ef502-dfca-43aa-83b8-9740f2a53215 req-e865d53a-74b3-42d2-a61f-d9315df3abc0 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received unexpected event network-vif-plugged-115a6cca-db08-49e7-9978-7b78f2fbf532 for instance with vm_state deleted and task_state None.
Nov 29 14:50:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:43 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Deleted allocations for instance ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f5c9e2-1d9a-4ba8-8923-a18072d59dc2 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:50:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Instance spawned successfully.
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:50:43 user nova-compute[75215]: INFO nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] No waiting events found dispatching network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:43 user nova-compute[75215]: WARNING nova.compute.manager [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received unexpected event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f for instance with vm_state building and task_state spawning.
Nov 29 14:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c86088-7e90-4810-bf44-fee64362dbb5 req-56f49cdb-8016-48f0-9b18-4157f86c5713 service nova] [instance: ab6a7bb8-b23c-441c-a8f5-71e9a182e3c9] Received event network-vif-deleted-115a6cca-db08-49e7-9978-7b78f2fbf532 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:43 user nova-compute[75215]: INFO nova.compute.manager [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Took 7.05 seconds to build instance.
Nov 29 14:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-688a29b6-0e89-43eb-8708-639c99420b3a tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.162s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:51 user nova-compute[75215]: INFO nova.compute.manager [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Terminating instance
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-unplugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] No waiting events found dispatching network-vif-unplugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ab650bb-aa1e-48dc-959e-c41e743f61d3 req-5d9ab689-bda6-45aa-9e09-4ec05d1aae95 service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-unplugged-8f1949fd-f68f-42dc-93ec-f7742629332e for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Instance destroyed successfully.
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lazy-loading 'resources' on Instance uuid d170452a-01be-41dc-ae3e-3950ace74907 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2011519197',display_name='tempest-TestVolumeSwap-server-2011519197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2011519197',id=7,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAd4maefoGLi4v5c/ccGJfh7kNuG9NEyvhZa6yla6O8W0c6fh9d/4N3acdRDiw/aeDugWvOlNaEu7WA7Io2uSp6VFs4jnIPv6WTmw8zEjGyIbilQGvfs9b2qqYzrnwK3w==',key_name='tempest-keypair-898194672',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9374847be0374c3a853e9d3a34cac7e7',ramdisk_id='',reservation_id='r-5lhbtvq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1379538774',owner_user_name='tempest-TestVolumeSwap-1379538774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6e575c78db046d498b414e680afe3eb',uuid=d170452a-01be-41dc-ae3e-3950ace74907,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converting VIF {"id": "8f1949fd-f68f-42dc-93ec-f7742629332e", "address": "fa:16:3e:4e:58:52", "network": {"id": "a527e560-4dd6-46e2-9661-c829695c4759", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1686819036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9374847be0374c3a853e9d3a34cac7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1949fd-f6", "ovs_interfaceid": "8f1949fd-f68f-42dc-93ec-f7742629332e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG os_vif [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1949fd-f6, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b94a35-cb03-4306-9a0d-7f43513d42ec) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:51 user nova-compute[75215]: INFO os_vif [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:58:52,bridge_name='br-int',has_traffic_filtering=True,id=8f1949fd-f68f-42dc-93ec-f7742629332e,network=Network(a527e560-4dd6-46e2-9661-c829695c4759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1949fd-f6')
Nov 29 14:50:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Deleting instance files /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907_del
Nov 29 14:50:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Deletion of /opt/stack/data/nova/instances/d170452a-01be-41dc-ae3e-3950ace74907_del complete
Nov 29 14:50:51 user nova-compute[75215]: INFO nova.compute.manager [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 14:50:51 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:50:51 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:50:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:52 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:52 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Took 0.69 seconds to deallocate network for instance.
Nov 29 14:50:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:53 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Deleted allocations for instance d170452a-01be-41dc-ae3e-3950ace74907
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9ee33df-e29b-41df-8910-9aa2c7de01c1 tempest-TestVolumeSwap-1379538774 tempest-TestVolumeSwap-1379538774-project-member] Lock "d170452a-01be-41dc-ae3e-3950ace74907" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] Acquiring lock "d170452a-01be-41dc-ae3e-3950ace74907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] Lock "d170452a-01be-41dc-ae3e-3950ace74907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] No waiting events found dispatching network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:53 user nova-compute[75215]: WARNING nova.compute.manager [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received unexpected event network-vif-plugged-8f1949fd-f68f-42dc-93ec-f7742629332e for instance with vm_state deleted and task_state None.
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7ca2fae-e4cb-4ee5-9591-b2ee84b3e3b0 req-7b805384-6aa0-44fe-9d6e-e158068af8fd service nova] [instance: d170452a-01be-41dc-ae3e-3950ace74907] Received event network-vif-deleted-8f1949fd-f68f-42dc-93ec-f7742629332e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-changed-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Refreshing instance network info cache due to event network-changed-2e908e58-ac66-489e-b05c-69fcccc1f750. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Refreshing network info cache for port 2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:53 user nova-compute[75215]: INFO nova.compute.manager [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Terminating instance
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updated VIF entry in instance network info cache for port 2e908e58-ac66-489e-b05c-69fcccc1f750. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f2bb2c-7f4b-47fd-a66e-306cbeb82027 req-de5540c2-8d0c-4371-90af-27a07b8a2e91 service nova] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-unplugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] No waiting events found dispatching network-vif-unplugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b8be357-e4a1-46de-a3b2-5d3ddf84b262 req-b6463cd8-8954-4900-8152-773c78e8b35a service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-unplugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance destroyed successfully.
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'resources' on Instance uuid 706eda24-7f1a-4a11-836f-81777fbee1a1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-668738058',display_name='tempest-TestStampPattern-server-668738058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-668738058',id=16,image_ref='4809ab4e-27cb-4437-94da-a4f4634a6b76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:48:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-d8v2es99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3f429494-a371-4b16-8659-bd56c4e7a775',image_min_disk='1',image_min_ram='0',image_owner_id='1daf66a83db841908f3aea8c06feed26',image_owner_project_name='tempest-TestStampPattern-678480478',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678480478-project-member',image_user_id='305d74ce2c5d45808e89090d17e4271c',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:48:05Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=706eda24-7f1a-4a11-836f-81777fbee1a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "address": "fa:16:3e:38:4a:db", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce19f3e2-1c", "ovs_interfaceid": "ce19f3e2-1caa-4a09-8027-3947a5a0209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG os_vif [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce19f3e2-1c, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09e26605-fdfb-43db-8ac4-84fcebc668d0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:54 user nova-compute[75215]: INFO os_vif [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=ce19f3e2-1caa-4a09-8027-3947a5a0209d,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce19f3e2-1c')
Nov 29 14:50:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Deleting instance files /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1_del
Nov 29 14:50:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Deletion of /opt/stack/data/nova/instances/706eda24-7f1a-4a11-836f-81777fbee1a1_del complete
Nov 29 14:50:54 user nova-compute[75215]: INFO nova.compute.manager [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 14:50:54 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:50:54 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:55 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Took 0.48 seconds to deallocate network for instance.
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing instance network info cache due to event network-changed-ce19f3e2-1caa-4a09-8027-3947a5a0209d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] Acquiring lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] Acquired lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Refreshing network info cache for port ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] Releasing lock "refresh_cache-706eda24-7f1a-4a11-836f-81777fbee1a1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f6bf64b-188f-4679-9a06-3f680c315c57 req-6143ae43-f867-4071-91c9-0afb09b88f76 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-deleted-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:55 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Deleted allocations for instance 706eda24-7f1a-4a11-836f-81777fbee1a1
Nov 29 14:50:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9be7509b-2163-4bb9-8c6e-34f847ea0d53 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.080s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] Acquiring lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] Lock "706eda24-7f1a-4a11-836f-81777fbee1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] No waiting events found dispatching network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:50:56 user nova-compute[75215]: WARNING nova.compute.manager [req-da37cf09-9c59-49fa-8620-813aefec8a70 req-0a272fa6-8cb4-4a9e-a1b1-71bc5dae8a81 service nova] [instance: 706eda24-7f1a-4a11-836f-81777fbee1a1] Received unexpected event network-vif-plugged-ce19f3e2-1caa-4a09-8027-3947a5a0209d for instance with vm_state deleted and task_state None.
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 is timed out.
Nov 29 14:50:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Successfully detached device vdb from instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 from the live domain config.
Nov 29 14:50:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njQmlVbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bab92a-df4f-4822-82ce-0f49bde76c76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:50:57 user nova-compute[75215]: No targets found.
Nov 29 14:50:57 user nova-compute[75215]: iSNS:
Nov 29 14:50:57 user nova-compute[75215]: No targets found.
Nov 29 14:50:57 user nova-compute[75215]: STATIC:
Nov 29 14:50:57 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db
Nov 29 14:50:57 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:57 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:57 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1
Nov 29 14:50:57 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:50:57 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:50:57 user nova-compute[75215]: FIRMWARE:
Nov 29 14:50:57 user nova-compute[75215]: No targets found.
Nov 29 14:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:50:57 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:50:57 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f594a3-d06c-4958-940c-1e23bc1812b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368da92-d331-4c30-8a1a-2f7aa29cfbab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:57 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db (non-flash)
Nov 29 14:50:57 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88301bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda78568-d801-428f-a70e-658b971dd48a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7479c2-5237-4ad1-8b9c-e0a12b555e2d]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:50:58 user nova-compute[75215]: INFO nova.compute.manager [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Attaching volume c152f15a-bb2f-471b-ba94-dd8ad59844f5 to /dev/vdb
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d5465-1265-48f3-be35-0c5ec3df942f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94789de9-5374-4a9d-8c7f-84dd03a553d1]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.utils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc2d2d-f499-4455-a9d6-025a59325332]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b44d57-0377-4dae-9b40-2f820411bfa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b3a7b-bc74-4bc2-b550-2c1f6d88d7ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d425a2-f0c2-43e8-96d8-9aa24013c0e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1535385-d5da-4eec-ad5e-1415b66e8cc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecac905-5a50-47c8-ab01-d548b26922d9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260]
Nov 29 14:50:58 user nova-compute[75215]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db, portal: 172.16.0.220,3260] successful.
Nov 29 14:50:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:50:58 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df3d91-a261-4f50-8a94-d60c27390c59]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.utils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating existing volume attachment record: 4356a41b-3a7f-4732-8ad2-1753066850fd {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce68cdba-83fd-46cd-8f87-58e082a648db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e345c06-0e18-47db-a224-36d832ca0d4e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] <== disconnect_volume: return (458ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:51:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7138MB free_disk=24.86623764038086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 3f429494-a371-4b16-8659-bd56c4e7a775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ca8bbeda-c444-438b-9099-55a9b12ab00f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'flavor' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fa7451b2-2f2d-43ae-aef4-6331b9a48c62 tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.759s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:51:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:51:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:51:05 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18278b3e-6b19-4e09-8485-3806ec1788ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:51:05 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c703b80e-c510-4ee7-9cf0-73c6e1a5b4bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5] added
Nov 29 14:51:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47ec2dc-ced2-4bfc-8261-31592c6db65c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c205d6-a917-48b8-a786-a5b676ba36b0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXOUBHWQ {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXOUBHWQ" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9bda81-069b-422e-aac4-70932448d21c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RXOUBHWQ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0636d8-115f-4f6d-9c92-9aadc28a04c0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db701b5d-850e-435d-adc8-66924c9982f9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7cd712-bbcd-4240-b118-3a09e6934f26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]
Nov 29 14:51:06 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.
Nov 29 14:51:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7092ba8-83d0-460f-b555-41265c12e4d4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c08783-3a72-47df-8d72-d23856264efb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:51:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748856f-e46b-494b-831b-e99c386a3ca6]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:51:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23362313333613061', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362313333613061', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:51:07 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:51:07 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:51:07 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:51:07 user nova-compute[75215]:   <serial>c152f15a-bb2f-471b-ba94-dd8ad59844f5</serial>
Nov 29 14:51:07 user nova-compute[75215]: </disk>
Nov 29 14:51:07 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No VIF found with MAC fa:16:3e:85:ed:19, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8cbeecc1-5e78-4e2d-ad6a-cd955da99bb1 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.712s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75215) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:08 user nova-compute[75215]: WARNING nova.compute.manager [req-90169405-0d84-41fe-b724-4129cde692d1 req-6e03ac9c-1138-407f-9218-c9da300c3328 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state powering-off.
Nov 29 14:51:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance destroyed successfully.
Nov 29 14:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:51:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-75229df2-0b4f-440e-9ee5-993231f51bf0 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.848s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:10 user nova-compute[75215]: WARNING nova.compute.manager [req-3b08c68b-2c64-4a7a-93bb-397f6a47eefd req-ea82e4b8-80e2-44bc-8f81-04ee4da1e3ab service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state None.
Nov 29 14:51:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing instance network info cache due to event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:51:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated VIF entry in instance network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:51:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bb46e05-31ca-4e79-aaa1-790be1db53b5 req-fdb9a8ea-3d5a-4301-afdc-ee80ddb20eb6 service nova] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-changed-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Refreshing instance network info cache due to event network-changed-9c699603-deba-4c85-a935-74136b77ed44. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:51:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Refreshing network info cache for port 9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:51:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updated VIF entry in instance network info cache for port 9c699603-deba-4c85-a935-74136b77ed44. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:51:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac92c254-9c5c-47f0-8cc3-a0b9d294a005 req-9e0467f7-6490-4748-a500-63e088369a97 service nova] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:27 user nova-compute[75215]: INFO nova.compute.manager [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Terminating instance
Nov 29 14:51:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-fc572bb3-bb51-4933-82a9-fc98b77c3921 req-8279dbc8-dd4c-49a8-80c6-5693da0bfcd4 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-unplugged-53921259-ca48-418b-959d-c373a73a6807 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:51:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Instance destroyed successfully.
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lazy-loading 'resources' on Instance uuid fae0e81c-9fcc-4a56-a9eb-876c830820b2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-9420683',display_name='tempest-ServerStableDeviceRescueTest-server-9420683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-9420683',id=3,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8l9zcAEfUJXLwxmzSZOyd4p4+vXl/nKxXU8V2PI2b/26W84tahbT/rs54F6AwquAB8jS4d6Y7URrR2u/52PAQ7tNAFyIGq0BuJQ6i2FCjlQKPS/1rNird42qquTp52ww==',key_name='tempest-keypair-468001882',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:48:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bbf5053f1114a2aa4ed9a5ed0d51614',ramdisk_id='',reservation_id='r-f63jdpqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-551332558',owner_user_name='tempest-ServerStableDeviceRescueTest-551332558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a063f501a31542d697e9d55b0cfae654',uuid=fae0e81c-9fcc-4a56-a9eb-876c830820b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converting VIF {"id": "53921259-ca48-418b-959d-c373a73a6807", "address": "fa:16:3e:23:8d:64", "network": {"id": "4a105dd2-643e-49a6-9e7e-fa6fe081cddd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-346973742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bbf5053f1114a2aa4ed9a5ed0d51614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53921259-ca", "ovs_interfaceid": "53921259-ca48-418b-959d-c373a73a6807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG os_vif [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53921259-ca, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdb59345-781e-4307-ad3f-cf84fe6a624c) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:28 user nova-compute[75215]: INFO os_vif [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8d:64,bridge_name='br-int',has_traffic_filtering=True,id=53921259-ca48-418b-959d-c373a73a6807,network=Network(4a105dd2-643e-49a6-9e7e-fa6fe081cddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53921259-ca')
Nov 29 14:51:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Deleting instance files /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2_del
Nov 29 14:51:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Deletion of /opt/stack/data/nova/instances/fae0e81c-9fcc-4a56-a9eb-876c830820b2_del complete
Nov 29 14:51:28 user nova-compute[75215]: INFO nova.compute.manager [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 14:51:28 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:51:28 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-f72e8031-9847-46de-b35f-181a7932148d req-87559daa-9b5f-40ba-a5eb-089b871069f8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-deleted-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:29 user nova-compute[75215]: INFO nova.compute.manager [req-f72e8031-9847-46de-b35f-181a7932148d req-87559daa-9b5f-40ba-a5eb-089b871069f8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Neutron deleted interface 53921259-ca48-418b-959d-c373a73a6807; detaching it from the instance and deleting it from the info cache
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-f72e8031-9847-46de-b35f-181a7932148d req-87559daa-9b5f-40ba-a5eb-089b871069f8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:29 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Took 0.83 seconds to deallocate network for instance.
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-f72e8031-9847-46de-b35f-181a7932148d req-87559daa-9b5f-40ba-a5eb-089b871069f8 service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Detach interface failed, port_id=53921259-ca48-418b-959d-c373a73a6807, reason: Instance fae0e81c-9fcc-4a56-a9eb-876c830820b2 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:51:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:30 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Deleted allocations for instance fae0e81c-9fcc-4a56-a9eb-876c830820b2
Nov 29 14:51:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3b64599-1f41-4337-9120-c186584ce34c tempest-ServerStableDeviceRescueTest-551332558 tempest-ServerStableDeviceRescueTest-551332558-project-member] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] Acquiring lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] Lock "fae0e81c-9fcc-4a56-a9eb-876c830820b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] No waiting events found dispatching network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:30 user nova-compute[75215]: WARNING nova.compute.manager [req-be111a28-39ee-44c0-8f87-fe144c31d317 req-3e4f9cf0-c191-40eb-ad56-ae64c2af976f service nova] [instance: fae0e81c-9fcc-4a56-a9eb-876c830820b2] Received unexpected event network-vif-plugged-53921259-ca48-418b-959d-c373a73a6807 for instance with vm_state deleted and task_state None.
Nov 29 14:51:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:51:32 user nova-compute[75215]: INFO nova.compute.manager [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] instance snapshotting
Nov 29 14:51:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Beginning live snapshot process
Nov 29 14:51:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58.delta 1073741824" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 14:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:51:34 user nova-compute[75215]: INFO nova.compute.claims [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Claim successful on node user
Nov 29 14:51:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] COPY block job progress, current cursor: 16973824 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:51:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 14:51:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.policy [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f3cbb55df1494f94e304bfc82c4c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce0446252d5486794553a9cae9281af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58.delta /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:51:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Creating image(s)
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.334s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58.delta /opt/stack/data/nova/instances/snapshots/tmp7f6iojsf/dfaf77503dcf45e88d1236fb7a469c58" returned: 0 in 0.751s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Snapshot extracted, beginning image upload
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.363s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.425s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Successfully created port: d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Cannot resize image /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Successfully updated port: d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing instance network info cache due to event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance network_info: |[{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start _get_guest_xml network_info=[{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:51:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:51:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfwG4b4uJiI1Qp7Xu2eqaKSPf20u0Bc1yueaialTyylMIYUIT4wQHxg3y4ubwKAALxf6HX+RyE5C4hNXygmwBIxMXPqYjnKMwLwAmRIwlaf1q2AN2Ij1fMUMKjmwhzFSQ==',key_name='tempest-keypair-1964351599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_devices' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:51:37 user nova-compute[75215]:   <uuid>30087951-cb13-465c-8658-93fd8f413b5f</uuid>
Nov 29 14:51:37 user nova-compute[75215]:   <name>instance-00000017</name>
Nov 29 14:51:37 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:51:37 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:51:37 user nova-compute[75215]:   <metadata>
Nov 29 14:51:37 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:51:37 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1506387384</nova:name>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:51:37</nova:creationTime>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:51:37 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:51:37 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:owner>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:user uuid="21f3cbb55df1494f94e304bfc82c4c5c">tempest-AttachVolumeShelveTestJSON-1453470125-project-member</nova:user>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:project uuid="bce0446252d5486794553a9cae9281af">tempest-AttachVolumeShelveTestJSON-1453470125</nova:project>
Nov 29 14:51:37 user nova-compute[75215]:       </nova:owner>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:51:37 user nova-compute[75215]:       <nova:ports>
Nov 29 14:51:37 user nova-compute[75215]:         <nova:port uuid="d308f9fc-29b3-4820-8aea-0f43bd60c687">
Nov 29 14:51:37 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:51:37 user nova-compute[75215]:         </nova:port>
Nov 29 14:51:37 user nova-compute[75215]:       </nova:ports>
Nov 29 14:51:37 user nova-compute[75215]:     </nova:instance>
Nov 29 14:51:37 user nova-compute[75215]:   </metadata>
Nov 29 14:51:37 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:51:37 user nova-compute[75215]:     <system>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="serial">30087951-cb13-465c-8658-93fd8f413b5f</entry>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="uuid">30087951-cb13-465c-8658-93fd8f413b5f</entry>
Nov 29 14:51:37 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:51:37 user nova-compute[75215]:     </system>
Nov 29 14:51:37 user nova-compute[75215]:   </sysinfo>
Nov 29 14:51:37 user nova-compute[75215]:   <os>
Nov 29 14:51:37 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:51:37 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:51:37 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:51:37 user nova-compute[75215]:   </os>
Nov 29 14:51:37 user nova-compute[75215]:   <features>
Nov 29 14:51:37 user nova-compute[75215]:     <acpi/>
Nov 29 14:51:37 user nova-compute[75215]:     <apic/>
Nov 29 14:51:37 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:51:37 user nova-compute[75215]:   </features>
Nov 29 14:51:37 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:51:37 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:51:37 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:51:37 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:51:37 user nova-compute[75215]:   </clock>
Nov 29 14:51:37 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:51:37 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:51:37 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:51:37 user nova-compute[75215]:   </cpu>
Nov 29 14:51:37 user nova-compute[75215]:   <devices>
Nov 29 14:51:37 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:51:37 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:51:37 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk"/>
Nov 29 14:51:37 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:51:37 user nova-compute[75215]:     </disk>
Nov 29 14:51:37 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:51:37 user nova-compute[75215]:       <mac address="fa:16:3e:1c:ae:d6"/>
Nov 29 14:51:37 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:51:37 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:51:37 user nova-compute[75215]:       <target dev="tapd308f9fc-29"/>
Nov 29 14:51:37 user nova-compute[75215]:     </interface>
Nov 29 14:51:37 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:51:37 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/console.log" append="off"/>
Nov 29 14:51:37 user nova-compute[75215]:     </serial>
Nov 29 14:51:37 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:51:37 user nova-compute[75215]:     <video>
Nov 29 14:51:37 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:51:37 user nova-compute[75215]:     </video>
Nov 29 14:51:37 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:51:37 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:51:37 user nova-compute[75215]:     </rng>
Nov 29 14:51:37 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:51:37 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:51:37 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:51:37 user nova-compute[75215]:     </memballoon>
Nov 29 14:51:37 user nova-compute[75215]:   </devices>
Nov 29 14:51:37 user nova-compute[75215]: </domain>
Nov 29 14:51:37 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfwG4b4uJiI1Qp7Xu2eqaKSPf20u0Bc1yueaialTyylMIYUIT4wQHxg3y4ubwKAALxf6HX+RyE5C4hNXygmwBIxMXPqYjnKMwLwAmRIwlaf1q2AN2Ij1fMUMKjmwhzFSQ==',key_name='tempest-keypair-1964351599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG os_vif [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5e51e0f-aa39-532d-87e8-db6657701644', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd308f9fc-29, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd308f9fc-29, col_values=(('qos', UUID('8ce5392e-9715-4726-a11d-f59a06b7d834')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd308f9fc-29, col_values=(('external_ids', {'iface-id': 'd308f9fc-29b3-4820-8aea-0f43bd60c687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ae:d6', 'vm-uuid': '30087951-cb13-465c-8658-93fd8f413b5f'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:37 user nova-compute[75215]: INFO os_vif [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29')
Nov 29 14:51:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:51:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No VIF found with MAC fa:16:3e:1c:ae:d6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:51:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updated VIF entry in instance network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:51:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-616c27a8-ee3d-45fc-b321-998347a1886a req-7aa72e48-77b7-4799-b0c5-03fb79287a59 service nova] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Snapshot image upload complete
Nov 29 14:51:39 user nova-compute[75215]: INFO nova.compute.manager [None req-8c13491b-0b1d-4b18-9668-61f8ab2a0502 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Took 6.91 seconds to snapshot the instance on the hypervisor.
Nov 29 14:51:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:39 user nova-compute[75215]: WARNING nova.compute.manager [req-e67bebeb-471e-4c2b-83d2-58f1679e9df5 req-1da9e233-c190-42f3-9756-62896701ec14 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state building and task_state spawning.
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:51:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance spawned successfully.
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:41 user nova-compute[75215]: WARNING nova.compute.manager [req-ef2c670a-9a4b-44fe-8d11-9e40e27149be req-e550f970-6e89-49cf-b110-7eb13400e44e service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state building and task_state spawning.
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:51:41 user nova-compute[75215]: INFO nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 29 14:51:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:51:41 user nova-compute[75215]: INFO nova.compute.manager [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Took 7.44 seconds to build instance.
Nov 29 14:51:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d34200b-9fef-42f5-9c40-d797274705a4 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.567s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:51:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:51:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing instance network info cache due to event network-changed-6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] Acquiring lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] Acquired lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Refreshing network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:57 user nova-compute[75215]: INFO nova.compute.manager [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Terminating instance
Nov 29 14:51:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-unplugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] No waiting events found dispatching network-vif-unplugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-7053eb9c-e112-45d2-94eb-d70e34eb15bc req-495ae8f1-a249-4109-b053-42c26d286a3e service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-unplugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updated VIF entry in instance network info cache for port 6d29593e-5ac3-432a-ba73-08df8ba27e0a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [{"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-74a6f487-fc45-47a5-a925-fff07f3b88d8 req-422432a1-c1ae-414b-8a60-e33be9e50e7a service nova] Releasing lock "refresh_cache-3f429494-a371-4b16-8659-bd56c4e7a775" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Instance destroyed successfully.
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lazy-loading 'resources' on Instance uuid 3f429494-a371-4b16-8659-bd56c4e7a775 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1528586113',display_name='tempest-TestStampPattern-server-1528586113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1528586113',id=6,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr6oYSNvlbY6qkIj46iFFrGNgJ5Yr+0ijFtyrRfRYztgYZoS3JsTw+TUnIu483pHbNunnAkhRYOTgPgDySW+M8ig7bHUYuMxYC+ZgbZ9eh48NK9RINY/DaQf35EMwMo6g==',key_name='tempest-TestStampPattern-1282336634',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:44:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1daf66a83db841908f3aea8c06feed26',ramdisk_id='',reservation_id='r-saq70r90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-678480478',owner_user_name='tempest-TestStampPattern-678480478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:47:53Z,user_data=None,user_id='305d74ce2c5d45808e89090d17e4271c',uuid=3f429494-a371-4b16-8659-bd56c4e7a775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converting VIF {"id": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "address": "fa:16:3e:c3:c2:b9", "network": {"id": "482365e2-21e0-40c1-9613-765a2303d1cb", "bridge": "br-int", "label": "tempest-TestStampPattern-779257851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1daf66a83db841908f3aea8c06feed26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29593e-5a", "ovs_interfaceid": "6d29593e-5ac3-432a-ba73-08df8ba27e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG os_vif [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d29593e-5a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=897b70c1-23e8-402c-91cd-24f28c3b260a) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: INFO os_vif [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c2:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d29593e-5ac3-432a-ba73-08df8ba27e0a,network=Network(482365e2-21e0-40c1-9613-765a2303d1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29593e-5a')
Nov 29 14:51:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Deleting instance files /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775_del
Nov 29 14:51:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Deletion of /opt/stack/data/nova/instances/3f429494-a371-4b16-8659-bd56c4e7a775_del complete
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:51:58 user nova-compute[75215]: INFO nova.compute.manager [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:51:59 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Took 0.75 seconds to deallocate network for instance.
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-04b13731-d2d0-439a-9536-5807061faa47 req-21913017-64bd-410a-a96d-cf75414e42ae service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-deleted-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:51:59 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Deleted allocations for instance 3f429494-a371-4b16-8659-bd56c4e7a775
Nov 29 14:51:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:51:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] Acquiring lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] Lock "3f429494-a371-4b16-8659-bd56c4e7a775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] No waiting events found dispatching network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:00 user nova-compute[75215]: WARNING nova.compute.manager [req-da38dbe1-33ab-4c22-a6b5-2fec90479c8b req-ac466208-6256-4f86-97a6-87245e97d048 service nova] [instance: 3f429494-a371-4b16-8659-bd56c4e7a775] Received unexpected event network-vif-plugged-6d29593e-5ac3-432a-ba73-08df8ba27e0a for instance with vm_state deleted and task_state None.
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f118f57-01d1-41c8-ae54-a17e6a0e0583 tempest-TestStampPattern-678480478 tempest-TestStampPattern-678480478-project-member] Lock "3f429494-a371-4b16-8659-bd56c4e7a775" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.592s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7548MB free_disk=24.99167251586914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ca8bbeda-c444-438b-9099-55a9b12ab00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 30087951-cb13-465c-8658-93fd8f413b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:07 user nova-compute[75215]: INFO nova.compute.manager [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Rescuing
Nov 29 14:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:08 user nova-compute[75215]: WARNING nova.compute.manager [req-fd0d3ea5-c1d1-423e-ab7d-97218e543cbb req-a95c95ef-55bc-46b3-a84e-97c420b1b728 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state active and task_state rescuing.
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance destroyed successfully.
Nov 29 14:52:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Attempting rescue
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:52:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Creating image(s)
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue" returned: 0 in 0.065s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'migration_context' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<a7d3b8e1-c2b3-4175-aef6-db44f969b212> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start _get_guest_xml network_info=[{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:48:3d:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<a7d3b8e1-c2b3-4175-aef6-db44f969b212> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'numa_topology' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<a7d3b8e1-c2b3-4175-aef6-db44f969b212> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<a7d3b8e1-c2b3-4175-aef6-db44f969b212> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402449986',display_name='tempest-ServerRescueNegativeTestJSON-server-402449986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402449986',id=13,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-dnyei47m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:47:31Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=a7d3b8e1-c2b3-4175-aef6-db44f969b212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:48:3d:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:48:3d:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<a7d3b8e1-c2b3-4175-aef6-db44f969b212> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:52:09 user nova-compute[75215]:   <uuid>a7d3b8e1-c2b3-4175-aef6-db44f969b212</uuid>
Nov 29 14:52:09 user nova-compute[75215]:   <name>instance-0000000d</name>
Nov 29 14:52:09 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:52:09 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:52:09 user nova-compute[75215]:   <metadata>
Nov 29 14:52:09 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:52:09 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-402449986</nova:name>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:52:09</nova:creationTime>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:52:09 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:52:09 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:owner>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:52:09 user nova-compute[75215]:       </nova:owner>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:52:09 user nova-compute[75215]:       <nova:ports>
Nov 29 14:52:09 user nova-compute[75215]:         <nova:port uuid="a984b5ed-5634-4973-97b8-a16a84dd6a18">
Nov 29 14:52:09 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:52:09 user nova-compute[75215]:         </nova:port>
Nov 29 14:52:09 user nova-compute[75215]:       </nova:ports>
Nov 29 14:52:09 user nova-compute[75215]:     </nova:instance>
Nov 29 14:52:09 user nova-compute[75215]:   </metadata>
Nov 29 14:52:09 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:52:09 user nova-compute[75215]:     <system>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="serial">a7d3b8e1-c2b3-4175-aef6-db44f969b212</entry>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="uuid">a7d3b8e1-c2b3-4175-aef6-db44f969b212</entry>
Nov 29 14:52:09 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:52:09 user nova-compute[75215]:     </system>
Nov 29 14:52:09 user nova-compute[75215]:   </sysinfo>
Nov 29 14:52:09 user nova-compute[75215]:   <os>
Nov 29 14:52:09 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:52:09 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:52:09 user nova-compute[75215]:   </os>
Nov 29 14:52:09 user nova-compute[75215]:   <features>
Nov 29 14:52:09 user nova-compute[75215]:     <acpi/>
Nov 29 14:52:09 user nova-compute[75215]:     <apic/>
Nov 29 14:52:09 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:52:09 user nova-compute[75215]:   </features>
Nov 29 14:52:09 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:52:09 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:52:09 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:52:09 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:52:09 user nova-compute[75215]:   </clock>
Nov 29 14:52:09 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:52:09 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:52:09 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:52:09 user nova-compute[75215]:   </cpu>
Nov 29 14:52:09 user nova-compute[75215]:   <devices>
Nov 29 14:52:09 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:52:09 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:52:09 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue"/>
Nov 29 14:52:09 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:52:09 user nova-compute[75215]:     </disk>
Nov 29 14:52:09 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:52:09 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:52:09 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk"/>
Nov 29 14:52:09 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:52:09 user nova-compute[75215]:     </disk>
Nov 29 14:52:09 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:52:09 user nova-compute[75215]:       <mac address="fa:16:3e:48:3d:b0"/>
Nov 29 14:52:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:52:09 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:52:09 user nova-compute[75215]:       <target dev="tapa984b5ed-56"/>
Nov 29 14:52:09 user nova-compute[75215]:     </interface>
Nov 29 14:52:09 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:52:09 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/console.log" append="off"/>
Nov 29 14:52:09 user nova-compute[75215]:     </serial>
Nov 29 14:52:09 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:52:09 user nova-compute[75215]:     <video>
Nov 29 14:52:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:52:09 user nova-compute[75215]:     </video>
Nov 29 14:52:09 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:52:09 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:52:09 user nova-compute[75215]:     </rng>
Nov 29 14:52:09 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:52:09 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:52:09 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:52:09 user nova-compute[75215]:     </memballoon>
Nov 29 14:52:09 user nova-compute[75215]:   </devices>
Nov 29 14:52:09 user nova-compute[75215]: </domain>
Nov 29 14:52:09 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:52:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance destroyed successfully.
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:52:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:48:3d:b0, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:10 user nova-compute[75215]: WARNING nova.compute.manager [req-f8b10e91-a79a-4405-a568-4bae0c9c0de8 req-ba9666a6-5458-4a0c-aee7-a85bf69f947d service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state active and task_state rescuing.
Nov 29 14:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:12 user nova-compute[75215]: WARNING nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state active and task_state rescuing.
Nov 29 14:52:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:12 user nova-compute[75215]: WARNING nova.compute.manager [req-5ae05df4-98d5-4635-945b-d16f72d2ad89 req-48a1419e-ef8e-488c-8577-5cd5a03d87a5 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state active and task_state rescuing.
Nov 29 14:52:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-55351a5c-9a8e-49ec-a775-92836d12f943 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:52:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-changed-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Refreshing instance network info cache due to event network-changed-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:52:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] Acquiring lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] Acquired lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Refreshing network info cache for port 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:28 user nova-compute[75215]: INFO nova.compute.manager [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Terminating instance
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updated VIF entry in instance network info cache for port 820f27ff-f8e9-4adc-9f10-1e5c0152bc3f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updating instance_info_cache with network_info: [{"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-357593bb-5d07-4ae7-884a-b117b0c1dd57 req-d0f214e7-e6de-414a-8999-5e12be0b541c service nova] Releasing lock "refresh_cache-ca8bbeda-c444-438b-9099-55a9b12ab00f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-unplugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] No waiting events found dispatching network-vif-unplugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-6cd709a9-5ccf-4133-833c-1c51b4a6b278 req-4e87f68e-ffc1-4256-9017-b1833357cfad service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-unplugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:52:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Instance destroyed successfully.
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'resources' on Instance uuid ca8bbeda-c444-438b-9099-55a9b12ab00f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835544930',display_name='tempest-AttachVolumeNegativeTest-server-835544930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835544930',id=22,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPtKmSPCpfmsjQ1b/MIUtwNkpXhYJTpfKs4Tnx9k1Vl0GqKiO0DdP+eFCt1FLekBOAREStbgNVKQ6MzkjCsXpjL5vF8vwBN+pPOcdYycI//TagCfgg3oXqo76eKPMjzng==',key_name='tempest-keypair-1122932569',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7tr0500m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=ca8bbeda-c444-438b-9099-55a9b12ab00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "address": "fa:16:3e:18:16:c1", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f27ff-f8", "ovs_interfaceid": "820f27ff-f8e9-4adc-9f10-1e5c0152bc3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG os_vif [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap820f27ff-f8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd436913-8e3d-424a-b5cc-6dfaa15a69c4) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:29 user nova-compute[75215]: INFO os_vif [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:16:c1,bridge_name='br-int',has_traffic_filtering=True,id=820f27ff-f8e9-4adc-9f10-1e5c0152bc3f,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f27ff-f8')
Nov 29 14:52:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Deleting instance files /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f_del
Nov 29 14:52:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Deletion of /opt/stack/data/nova/instances/ca8bbeda-c444-438b-9099-55a9b12ab00f_del complete
Nov 29 14:52:29 user nova-compute[75215]: INFO nova.compute.manager [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 14:52:29 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:52:29 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:30 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Took 0.88 seconds to deallocate network for instance.
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:30 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Deleted allocations for instance ca8bbeda-c444-438b-9099-55a9b12ab00f
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17d51513-f0ad-47a3-a093-c2f28cae19f1 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] Acquiring lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] Lock "ca8bbeda-c444-438b-9099-55a9b12ab00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] No waiting events found dispatching network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:30 user nova-compute[75215]: WARNING nova.compute.manager [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received unexpected event network-vif-plugged-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f for instance with vm_state deleted and task_state None.
Nov 29 14:52:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-f36088e2-37cb-4844-98ed-37427d942832 req-e2cd9dbf-546b-4564-9e03-6f7791ce83ee service nova] [instance: ca8bbeda-c444-438b-9099-55a9b12ab00f] Received event network-vif-deleted-820f27ff-f8e9-4adc-9f10-1e5c0152bc3f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:52:41 user nova-compute[75215]: INFO nova.compute.claims [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Claim successful on node user
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:52:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:52:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:52:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:52:42 user nova-compute[75215]: DEBUG nova.policy [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fad9c93f4ea491880e3cd7a97518367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72c331f6f384976bc971f9318b7d0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:52:42 user nova-compute[75215]: INFO nova.virt.block_device [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Booting with blank volume at /dev/vda
Nov 29 14:52:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Successfully created port: dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Successfully updated port: dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-changed-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Refreshing instance network info cache due to event network-changed-dff7cc4b-4afd-49ef-86e2-c53aff50a838. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] Acquiring lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance network_info: |[{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] Acquired lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Refreshing network info cache for port dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updated VIF entry in instance network info cache for port dff7cc4b-4afd-49ef-86e2-c53aff50a838. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f54676fb-29bd-4b49-a129-7daa107b888f req-0827a118-4f06-4fcc-ad5d-b0b09cd89d52 service nova] Releasing lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.utils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[868cd319-1c22-4120-aae8-911b5337b592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6bdb27-78f0-49ef-a198-d3d958a6ac63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30d87e-7832-4d4b-a43c-d97020e9a3d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e183ac9b-6abb-4ef2-b6b9-d6115658bf47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:52:47 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:52:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7e0f6-800f-4f1a-94fd-6c46a0081220]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG os_brick.utils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:52:47 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating existing volume attachment record: d269f79a-ed8d-4ae0-84ae-a58225dc7e01 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:52:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:52:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Creating image(s)
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Ensure instance console log exists: /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start _get_guest_xml network_info=[{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd269f79a-ed8d-4ae0-84ae-a58225dc7e01', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec51da57-b873-4e98-8267-e0d72c5e9097', 'attached_at': '', 'detached_at': '', 'volume_id': 'e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'serial': 'e683dc5b-716b-409a-9ae9-747f3a90fe0f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:52:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:52:55 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:52:55 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:52:55 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ad01ff-117f-4599-a903-e33b260b0d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:52:55 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c493795-b7a8-40a9-a406-a50a618e8738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f] added
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd135da-d65f-465b-8ecc-639f554ef281]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b3d97-fb12-47e3-a703-8b4ccc585e22]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVqLveGA {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVqLveGA" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28ba1c-a1ca-4c61-a291-8476029ea4c9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVqLveGA'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7863ac13-d5ec-4797-91d9-a9d2171fb4bc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88caff4e-a089-4d15-a591-4de8e19e903a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed6822-bf8d-4421-a87b-6e8eb0dd6e2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260]
Nov 29 14:52:55 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260] successful.
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec6a583-49b3-4e8f-b3bf-7028deaabda3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d131b3-886f-4245-ac9d-5d4b53950b12]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:55 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:52:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de2301-844a-4642-9b67-a7aa395104d9]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26135333932333936', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135333932333936', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-904665748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-904665748',id=24,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-0no060e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:52:42Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=ec51da57-b873-4e98-8267-e0d72c5e9097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:52:56 user nova-compute[75215]:   <uuid>ec51da57-b873-4e98-8267-e0d72c5e9097</uuid>
Nov 29 14:52:56 user nova-compute[75215]:   <name>instance-00000018</name>
Nov 29 14:52:56 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:52:56 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:52:56 user nova-compute[75215]:   <metadata>
Nov 29 14:52:56 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:52:56 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-904665748</nova:name>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:52:55</nova:creationTime>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:52:56 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:52:56 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:owner>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 14:52:56 user nova-compute[75215]:       </nova:owner>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:52:56 user nova-compute[75215]:       <nova:ports>
Nov 29 14:52:56 user nova-compute[75215]:         <nova:port uuid="dff7cc4b-4afd-49ef-86e2-c53aff50a838">
Nov 29 14:52:56 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 14:52:56 user nova-compute[75215]:         </nova:port>
Nov 29 14:52:56 user nova-compute[75215]:       </nova:ports>
Nov 29 14:52:56 user nova-compute[75215]:     </nova:instance>
Nov 29 14:52:56 user nova-compute[75215]:   </metadata>
Nov 29 14:52:56 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:52:56 user nova-compute[75215]:     <system>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="serial">ec51da57-b873-4e98-8267-e0d72c5e9097</entry>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="uuid">ec51da57-b873-4e98-8267-e0d72c5e9097</entry>
Nov 29 14:52:56 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:52:56 user nova-compute[75215]:     </system>
Nov 29 14:52:56 user nova-compute[75215]:   </sysinfo>
Nov 29 14:52:56 user nova-compute[75215]:   <os>
Nov 29 14:52:56 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:52:56 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:52:56 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:52:56 user nova-compute[75215]:   </os>
Nov 29 14:52:56 user nova-compute[75215]:   <features>
Nov 29 14:52:56 user nova-compute[75215]:     <acpi/>
Nov 29 14:52:56 user nova-compute[75215]:     <apic/>
Nov 29 14:52:56 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:52:56 user nova-compute[75215]:   </features>
Nov 29 14:52:56 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:52:56 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:52:56 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:52:56 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:52:56 user nova-compute[75215]:   </clock>
Nov 29 14:52:56 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:52:56 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:52:56 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:52:56 user nova-compute[75215]:   </cpu>
Nov 29 14:52:56 user nova-compute[75215]:   <devices>
Nov 29 14:52:56 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:52:56 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:52:56 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 14:52:56 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:52:56 user nova-compute[75215]:       <serial>e683dc5b-716b-409a-9ae9-747f3a90fe0f</serial>
Nov 29 14:52:56 user nova-compute[75215]:     </disk>
Nov 29 14:52:56 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:52:56 user nova-compute[75215]:       <mac address="fa:16:3e:09:0a:2b"/>
Nov 29 14:52:56 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:52:56 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:52:56 user nova-compute[75215]:       <target dev="tapdff7cc4b-4a"/>
Nov 29 14:52:56 user nova-compute[75215]:     </interface>
Nov 29 14:52:56 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:52:56 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/console.log" append="off"/>
Nov 29 14:52:56 user nova-compute[75215]:     </serial>
Nov 29 14:52:56 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:52:56 user nova-compute[75215]:     <video>
Nov 29 14:52:56 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:52:56 user nova-compute[75215]:     </video>
Nov 29 14:52:56 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:52:56 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:52:56 user nova-compute[75215]:     </rng>
Nov 29 14:52:56 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:52:56 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:52:56 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:52:56 user nova-compute[75215]:     </memballoon>
Nov 29 14:52:56 user nova-compute[75215]:   </devices>
Nov 29 14:52:56 user nova-compute[75215]: </domain>
Nov 29 14:52:56 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-904665748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-904665748',id=24,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-0no060e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:52:42Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=ec51da57-b873-4e98-8267-e0d72c5e9097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG os_vif [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f62d49a-c6c0-5497-bcc1-f805c247e92b', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff7cc4b-4a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdff7cc4b-4a, col_values=(('qos', UUID('9e8902c0-592a-40e8-8c42-f89ef14a4fa7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdff7cc4b-4a, col_values=(('external_ids', {'iface-id': 'dff7cc4b-4afd-49ef-86e2-c53aff50a838', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:0a:2b', 'vm-uuid': 'ec51da57-b873-4e98-8267-e0d72c5e9097'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:56 user nova-compute[75215]: INFO os_vif [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a')
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:52:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:09:0a:2b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:52:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:52:58 user nova-compute[75215]: WARNING nova.compute.manager [req-41159457-9795-4414-9a7d-2fe4d1887135 req-9a672d3f-68b7-46a5-b16a-8ec918c1486d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state building and task_state spawning.
Nov 29 14:52:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'info_cache' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:52:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance destroyed successfully.
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'resources' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e908e58-ac, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2eaa98e-81dd-4bf7-852d-e1559ba66191) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:52:59 user nova-compute[75215]: INFO os_vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:52:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:52:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c88a94-8319-4404-9116-fee614d88043]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:52:59 user nova-compute[75215]: No targets found.
Nov 29 14:52:59 user nova-compute[75215]: iSNS:
Nov 29 14:52:59 user nova-compute[75215]: No targets found.
Nov 29 14:52:59 user nova-compute[75215]: STATIC:
Nov 29 14:52:59 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:52:59 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:52:59 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:52:59 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1
Nov 29 14:52:59 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:52:59 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:52:59 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5
Nov 29 14:52:59 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:52:59 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:52:59 user nova-compute[75215]: FIRMWARE:
Nov 29 14:52:59 user nova-compute[75215]: No targets found.
Nov 29 14:52:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:52:59 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:52:59 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd00542-c8c1-4d7a-8fe7-7eaa8089ebef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc05480e-d12b-42ab-9a78-d0e0366f2685]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:59 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:59 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:52:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:52:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:52:59 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:52:59 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:52:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cbe33edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c31e7-aa03-4183-a846-60b3aae693e5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[379475a8-1ee8-41cb-97fb-e68d7bf20e85]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e13e86e-9c53-4eed-8ee9-d1a952c94cc2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb8db71-bd8a-4d87-aff2-7cc25498c58e]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66af4fb-551c-4573-b236-c47433258010]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e633acf-f00b-4fba-90e1-e65c73ca4284]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]
Nov 29 14:53:00 user nova-compute[75215]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a31de-7a1e-4a6b-822b-ac4fc8b2f77d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== disconnect_volume: return (383ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start _get_guest_xml network_info=[{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4356a41b-3a7f-4732-8ad2-1753066850fd', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '25d981de-63c5-4012-8f38-fca174d1f3f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'serial': 'c152f15a-bb2f-471b-ba94-dd8ad59844f5'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'numa_topology' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:00 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feaa38a-9950-463d-bf1f-5cd2912926aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:53:00 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd8d7d-ef6f-4bb1-8293-854c534d9fcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5] added
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c4c8d-6556-4519-9e9c-ffb0f30627c7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cea757-c55c-4ec8-b5aa-66a4e3ac4b29]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXOUBHWQ {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXOUBHWQ" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bd6661-5121-4af2-93ae-bd7d6e2245eb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RXOUBHWQ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e45df-f9ac-40d6-96da-4469f6f87caf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22267b5a-d834-4ca3-9c86-09662953ac1b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance spawned successfully.
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:00 user nova-compute[75215]: WARNING nova.compute.manager [req-116f68d0-5898-458a-9e8c-ccdde84b88b7 req-4d3a95d6-7b10-40c3-bac5-f06afb84b3c3 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state building and task_state spawning.
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95dcb0-7837-4098-a147-060851a28263]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]
Nov 29 14:53:00 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7dece-b362-486b-8670-cf6836bbe876]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8dfc9a-9c77-4d5e-9283-140a2eb2bf6f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:00 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: INFO nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f5df9-3596-4888-b490-9458b59ee882]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:00 user nova-compute[75215]: INFO nova.compute.manager [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Took 19.53 seconds to build instance.
Nov 29 14:53:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d4ffb716-4a24-4206-ab21-5a52194234a5 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.655s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23362313333613061', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362313333613061', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:53:01 user nova-compute[75215]:   <uuid>25d981de-63c5-4012-8f38-fca174d1f3f7</uuid>
Nov 29 14:53:01 user nova-compute[75215]:   <name>instance-00000012</name>
Nov 29 14:53:01 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:53:01 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:53:01 user nova-compute[75215]:   <metadata>
Nov 29 14:53:01 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:53:01 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-612258283</nova:name>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:53:00</nova:creationTime>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:53:01 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:53:01 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:owner>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:user uuid="bfc31705a39b4447a3ad96ca8d073144">tempest-AttachVolumeTestJSON-1589123637-project-member</nova:user>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:project uuid="7f0dc3e9a4bc447a80d5983bbafe3059">tempest-AttachVolumeTestJSON-1589123637</nova:project>
Nov 29 14:53:01 user nova-compute[75215]:       </nova:owner>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:53:01 user nova-compute[75215]:       <nova:ports>
Nov 29 14:53:01 user nova-compute[75215]:         <nova:port uuid="2e908e58-ac66-489e-b05c-69fcccc1f750">
Nov 29 14:53:01 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:53:01 user nova-compute[75215]:         </nova:port>
Nov 29 14:53:01 user nova-compute[75215]:       </nova:ports>
Nov 29 14:53:01 user nova-compute[75215]:     </nova:instance>
Nov 29 14:53:01 user nova-compute[75215]:   </metadata>
Nov 29 14:53:01 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:53:01 user nova-compute[75215]:     <system>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="serial">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="uuid">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:53:01 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:53:01 user nova-compute[75215]:     </system>
Nov 29 14:53:01 user nova-compute[75215]:   </sysinfo>
Nov 29 14:53:01 user nova-compute[75215]:   <os>
Nov 29 14:53:01 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:53:01 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:53:01 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:53:01 user nova-compute[75215]:   </os>
Nov 29 14:53:01 user nova-compute[75215]:   <features>
Nov 29 14:53:01 user nova-compute[75215]:     <acpi/>
Nov 29 14:53:01 user nova-compute[75215]:     <apic/>
Nov 29 14:53:01 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:53:01 user nova-compute[75215]:   </features>
Nov 29 14:53:01 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:53:01 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:53:01 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:53:01 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:53:01 user nova-compute[75215]:   </clock>
Nov 29 14:53:01 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:53:01 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:53:01 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:53:01 user nova-compute[75215]:   </cpu>
Nov 29 14:53:01 user nova-compute[75215]:   <devices>
Nov 29 14:53:01 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:53:01 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:53:01 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk"/>
Nov 29 14:53:01 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:53:01 user nova-compute[75215]:     </disk>
Nov 29 14:53:01 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:53:01 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:53:01 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 14:53:01 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:53:01 user nova-compute[75215]:       <serial>c152f15a-bb2f-471b-ba94-dd8ad59844f5</serial>
Nov 29 14:53:01 user nova-compute[75215]:     </disk>
Nov 29 14:53:01 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:53:01 user nova-compute[75215]:       <mac address="fa:16:3e:85:ed:19"/>
Nov 29 14:53:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:01 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:53:01 user nova-compute[75215]:       <target dev="tap2e908e58-ac"/>
Nov 29 14:53:01 user nova-compute[75215]:     </interface>
Nov 29 14:53:01 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:53:01 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/console.log" append="off"/>
Nov 29 14:53:01 user nova-compute[75215]:     </serial>
Nov 29 14:53:01 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:53:01 user nova-compute[75215]:     <video>
Nov 29 14:53:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:01 user nova-compute[75215]:     </video>
Nov 29 14:53:01 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:53:01 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:53:01 user nova-compute[75215]:     </rng>
Nov 29 14:53:01 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:53:01 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:53:01 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:53:01 user nova-compute[75215]:     </memballoon>
Nov 29 14:53:01 user nova-compute[75215]:   </devices>
Nov 29 14:53:01 user nova-compute[75215]: </domain>
Nov 29 14:53:01 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:53:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Cannot resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'migration_context' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.objects.base [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG os_vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0811feb-cd2f-50e5-8ce8-00b549892c24', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e908e58-ac, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e908e58-ac, col_values=(('qos', UUID('7d7fcf21-c1e8-43b5-b425-e5abec0962bd')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e908e58-ac, col_values=(('external_ids', {'iface-id': '2e908e58-ac66-489e-b05c-69fcccc1f750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:ed:19', 'vm-uuid': '25d981de-63c5-4012-8f38-fca174d1f3f7'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:02 user nova-compute[75215]: INFO os_vif [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7863MB free_disk=25.001564025878906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 30087951-cb13-465c-8658-93fd8f413b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:04 user nova-compute[75215]: WARNING nova.compute.manager [req-9e673daa-81ce-418f-94d5-01c19460092c req-034b1bbc-e4d9-4046-aaad-e5edd302a07b service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state powering-on.
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:06 user nova-compute[75215]: WARNING nova.compute.manager [req-9fa289e3-50e6-4977-a1ff-28ec0e220b72 req-58b0c07e-5fe6-4eee-abae-38103ed6914f service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state powering-on.
Nov 29 14:53:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:53:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance rebooted successfully.
Nov 29 14:53:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7ea80ca1-9965-4351-a6a5-81ee6e35ab81 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:53:09 user nova-compute[75215]: INFO nova.compute.claims [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Claim successful on node user
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:53:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.policy [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25bf6c00d9b340c78b2e136f22b2b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9445b58a3554c19b57afbffbaa6a112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:53:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Creating image(s)
Nov 29 14:53:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.254s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk 1073741824" returned: 0 in 0.081s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Cannot resize image /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Ensure instance console log exists: /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Successfully created port: 85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Successfully updated port: 85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-changed-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Refreshing instance network info cache due to event network-changed-85b5aaa0-3670-49a7-9244-6d1fb48ff135. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] Acquiring lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:53:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating instance_info_cache with network_info: [{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance network_info: |[{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] Acquired lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Refreshing network info cache for port 85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start _get_guest_xml network_info=[{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:53:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-tempest.common.compute-instance-969477839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'pci_devices' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:53:13 user nova-compute[75215]:   <uuid>27e9c891-3fb0-424a-b6b1-22a123c18271</uuid>
Nov 29 14:53:13 user nova-compute[75215]:   <name>instance-00000019</name>
Nov 29 14:53:13 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:53:13 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:53:13 user nova-compute[75215]:   <metadata>
Nov 29 14:53:13 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:53:13 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:name>tempest-tempest.common.compute-instance-969477839</nova:name>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:53:13</nova:creationTime>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:53:13 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:53:13 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:owner>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:user uuid="25bf6c00d9b340c78b2e136f22b2b211">tempest-ServerActionsTestOtherA-380950315-project-member</nova:user>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:project uuid="f9445b58a3554c19b57afbffbaa6a112">tempest-ServerActionsTestOtherA-380950315</nova:project>
Nov 29 14:53:13 user nova-compute[75215]:       </nova:owner>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:53:13 user nova-compute[75215]:       <nova:ports>
Nov 29 14:53:13 user nova-compute[75215]:         <nova:port uuid="85b5aaa0-3670-49a7-9244-6d1fb48ff135">
Nov 29 14:53:13 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:53:13 user nova-compute[75215]:         </nova:port>
Nov 29 14:53:13 user nova-compute[75215]:       </nova:ports>
Nov 29 14:53:13 user nova-compute[75215]:     </nova:instance>
Nov 29 14:53:13 user nova-compute[75215]:   </metadata>
Nov 29 14:53:13 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:53:13 user nova-compute[75215]:     <system>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="serial">27e9c891-3fb0-424a-b6b1-22a123c18271</entry>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="uuid">27e9c891-3fb0-424a-b6b1-22a123c18271</entry>
Nov 29 14:53:13 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:53:13 user nova-compute[75215]:     </system>
Nov 29 14:53:13 user nova-compute[75215]:   </sysinfo>
Nov 29 14:53:13 user nova-compute[75215]:   <os>
Nov 29 14:53:13 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:53:13 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:53:13 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:53:13 user nova-compute[75215]:   </os>
Nov 29 14:53:13 user nova-compute[75215]:   <features>
Nov 29 14:53:13 user nova-compute[75215]:     <acpi/>
Nov 29 14:53:13 user nova-compute[75215]:     <apic/>
Nov 29 14:53:13 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:53:13 user nova-compute[75215]:   </features>
Nov 29 14:53:13 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:53:13 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:53:13 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:53:13 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:53:13 user nova-compute[75215]:   </clock>
Nov 29 14:53:13 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:53:13 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:53:13 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:53:13 user nova-compute[75215]:   </cpu>
Nov 29 14:53:13 user nova-compute[75215]:   <devices>
Nov 29 14:53:13 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:53:13 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:53:13 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk"/>
Nov 29 14:53:13 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:53:13 user nova-compute[75215]:     </disk>
Nov 29 14:53:13 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:53:13 user nova-compute[75215]:       <mac address="fa:16:3e:26:97:ce"/>
Nov 29 14:53:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:13 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:53:13 user nova-compute[75215]:       <target dev="tap85b5aaa0-36"/>
Nov 29 14:53:13 user nova-compute[75215]:     </interface>
Nov 29 14:53:13 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:53:13 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/console.log" append="off"/>
Nov 29 14:53:13 user nova-compute[75215]:     </serial>
Nov 29 14:53:13 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:53:13 user nova-compute[75215]:     <video>
Nov 29 14:53:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:13 user nova-compute[75215]:     </video>
Nov 29 14:53:13 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:53:13 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:53:13 user nova-compute[75215]:     </rng>
Nov 29 14:53:13 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:53:13 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:53:13 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:53:13 user nova-compute[75215]:     </memballoon>
Nov 29 14:53:13 user nova-compute[75215]:   </devices>
Nov 29 14:53:13 user nova-compute[75215]: </domain>
Nov 29 14:53:13 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-tempest.common.compute-instance-969477839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG os_vif [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afb3d5f4-74c9-58c6-96d4-aa5efb875ec7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85b5aaa0-36, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85b5aaa0-36, col_values=(('qos', UUID('42d2fa0b-adb9-4ff0-938a-7e3722be5ae6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85b5aaa0-36, col_values=(('external_ids', {'iface-id': '85b5aaa0-3670-49a7-9244-6d1fb48ff135', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:97:ce', 'vm-uuid': '27e9c891-3fb0-424a-b6b1-22a123c18271'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:13 user nova-compute[75215]: INFO os_vif [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36')
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:26:97:ce, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updated VIF entry in instance network info cache for port 85b5aaa0-3670-49a7-9244-6d1fb48ff135. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:53:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating instance_info_cache with network_info: [{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9378e7e6-9b4e-4568-aaaa-6126799b549c req-488ff9ab-737a-48ef-88fb-abe4d020dfea service nova] Releasing lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:15 user nova-compute[75215]: WARNING nova.compute.manager [req-17f18384-0244-496d-9a5a-532a5ba4b17b req-e11dd8ab-7e36-4b09-ad18-c882b8f4b4d0 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state building and task_state spawning.
Nov 29 14:53:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'flavor' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:16 user nova-compute[75215]: INFO nova.compute.manager [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Attaching volume 6ad3b9cd-e702-40d1-818f-9a7d0a032286 to /dev/vdb
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd248d-91bc-4660-8d87-6c0cdfe50fd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3ccdc7-34ee-492b-8a38-db68b960abb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c52204-8f57-42d2-8c06-556b20726d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e7993-f6b6-4966-8219-2e2aebdb5acf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:53:16 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:53:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c8219d-4c07-4242-99db-b72312895428]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:16 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating existing volume attachment record: a62215af-f94d-44b2-9d5a-0a2aabae09fd {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:17 user nova-compute[75215]: WARNING nova.compute.manager [req-46033ab4-1e63-4c80-9369-20d40b13812c req-1336e252-87af-4324-97bb-ceb99d5d4f0f service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state building and task_state spawning.
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:53:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance spawned successfully.
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:17 user nova-compute[75215]: INFO nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 29 14:53:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:17 user nova-compute[75215]: INFO nova.compute.manager [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Took 7.64 seconds to build instance.
Nov 29 14:53:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fb0304b-6ff0-4d0c-905c-b9ecfab6f7e9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.787s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:20 user nova-compute[75215]: INFO nova.compute.manager [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Detaching volume 3a3a4773-06d5-48c7-898e-589e60293bb1
Nov 29 14:53:20 user nova-compute[75215]: INFO nova.virt.block_device [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Attempting to driver detach volume 3a3a4773-06d5-48c7-898e-589e60293bb1 from mountpoint /dev/vdb
Nov 29 14:53:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Attempting to detach device vdb from instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:53:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:53:20 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:53:20 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:53:20 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:53:20 user nova-compute[75215]:   <serial>3a3a4773-06d5-48c7-898e-589e60293bb1</serial>
Nov 29 14:53:20 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:53:20 user nova-compute[75215]: </disk>
Nov 29 14:53:20 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:53:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab from the persistent domain config.
Nov 29 14:53:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:53:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:53:20 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:53:20 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:53:20 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:53:20 user nova-compute[75215]:   <serial>3a3a4773-06d5-48c7-898e-589e60293bb1</serial>
Nov 29 14:53:20 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:53:20 user nova-compute[75215]: </disk>
Nov 29 14:53:20 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:53:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:53:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing instance network info cache due to event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:26 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:26 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:26 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356e8b7-554f-4816-8cce-c9d39a27983d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:53:26 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec3cab5-3bd5-4e61-b417-562e6f750e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ed55b-2811-495d-ada1-a63165b65a18]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351f907-dd86-48cb-b432-a5f90a39c15c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e390035-54df-42d0-9f7d-3c5d7b5ff9d5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APEYijve'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adecb2b-9f61-4f35-b0aa-76dd9743ad40]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ae4fb-ca33-4e14-9758-603011488437]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ecb5c5-88d2-4992-bb17-6b55d02393ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:53:26 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d761112-91cb-470e-818b-0af218467eda]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f6ce4e-d02d-4eec-8ef0-a04ec9c4c89c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbf321-d5fa-474b-a8a0-c85e7b3560b9]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updated VIF entry in instance network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:53:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a5f0d47-d190-49e2-8f64-606b531b00f8 req-3936aeda-e6f5-402f-a7ac-61e7bb5bffb9 service nova] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'flavor' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:53:27 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:53:27 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:53:27 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:53:27 user nova-compute[75215]:   <serial>6ad3b9cd-e702-40d1-818f-9a7d0a032286</serial>
Nov 29 14:53:27 user nova-compute[75215]: </disk>
Nov 29 14:53:27 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No VIF found with MAC fa:16:3e:c6:77:67, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9d47086c-d880-46bf-aa92-179a6bb30285 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.965s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:29 user nova-compute[75215]: INFO nova.compute.manager [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Shelving
Nov 29 14:53:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:30 user nova-compute[75215]: WARNING nova.compute.manager [req-0a3c93be-3b1c-4d74-a64e-b2252c56083a req-53969a69-df6c-4e5c-a04b-089abccdae1f service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state active and task_state shelving.
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:53:30 user nova-compute[75215]: INFO nova.compute.claims [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Claim successful on node user
Nov 29 14:53:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance destroyed successfully.
Nov 29 14:53:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Beginning cold snapshot process
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk /opt/stack/data/nova/instances/snapshots/tmp3s05evnb/d5b4917e351b460a8ddbe10bead61d4d {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Stashing vm_state: active {{(pid=75215) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.039s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:53:31 user nova-compute[75215]: INFO nova.compute.claims [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Claim successful on node user
Nov 29 14:53:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:53:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:53:32 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating resource usage from migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.policy [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54f0adb60951476ab67ad77e8b1dba1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3471da48257942a4a3882778b30ae9ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:53:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Creating image(s)
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "/opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "/opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "/opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:32 user nova-compute[75215]: WARNING nova.compute.manager [req-8d2ea16b-e73d-48b1-94a3-72e29c74b4d8 req-2c427fea-1983-4e31-acd7-6e3f5ce353cd service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk /opt/stack/data/nova/instances/snapshots/tmp3s05evnb/d5b4917e351b460a8ddbe10bead61d4d" returned: 0 in 1.272s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Snapshot extracted, beginning image upload
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.033s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:32 user nova-compute[75215]: INFO nova.compute.manager [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Migrating
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:32 user nova-compute[75215]: INFO nova.compute.rpcapi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk 1073741824" returned: 0 in 0.082s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Successfully created port: 1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.247s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:53:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Cannot resize image /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Ensure instance console log exists: /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Starting migrate_disk_and_power_off {{(pid=75215) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Successfully updated port: 1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquired lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-changed-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Refreshing instance network info cache due to event network-changed-1f565d20-bdd4-4c59-919d-1455a7e8900c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] Acquiring lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:34 user nova-compute[75215]: WARNING nova.compute.manager [req-37bd49b8-c8e8-476f-bd5b-a7ab032b9b87 req-cc16ad94-17f3-490d-841b-eb37725ab473 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating instance_info_cache with network_info: [{"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Releasing lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Instance network_info: |[{"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] Acquired lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Refreshing network info cache for port 1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Start _get_guest_xml network_info=[{"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:53:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2877110',id=26,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPlOIozfyLDA5Yyet+/F1GtNZgMDX6cIEK2juGbE2W7Yj5zgDql2Z7Yj8VPLBdfoIK2ZxafOBBbLJibSq7a2GTRxnvhBLegkgzsmYajFhGe0HQv2bQlNTnFwnqhWOziw==',key_name='tempest-keypair-545117171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3471da48257942a4a3882778b30ae9ba',ramdisk_id='',reservation_id='r-caj249bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54f0adb60951476ab67ad77e8b1dba1d',uuid=793c33dc-7213-4c2f-b419-bf15a1713c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converting VIF {"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lazy-loading 'pci_devices' on Instance uuid 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:53:34 user nova-compute[75215]:   <uuid>793c33dc-7213-4c2f-b419-bf15a1713c6e</uuid>
Nov 29 14:53:34 user nova-compute[75215]:   <name>instance-0000001a</name>
Nov 29 14:53:34 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:53:34 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:53:34 user nova-compute[75215]:   <metadata>
Nov 29 14:53:34 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:53:34 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067</nova:name>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:53:34</nova:creationTime>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:53:34 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:53:34 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:owner>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:user uuid="54f0adb60951476ab67ad77e8b1dba1d">tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member</nova:user>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:project uuid="3471da48257942a4a3882778b30ae9ba">tempest-TestServerVolumeAttachScenarioOldVersion-659879777</nova:project>
Nov 29 14:53:34 user nova-compute[75215]:       </nova:owner>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:53:34 user nova-compute[75215]:       <nova:ports>
Nov 29 14:53:34 user nova-compute[75215]:         <nova:port uuid="1f565d20-bdd4-4c59-919d-1455a7e8900c">
Nov 29 14:53:34 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:53:34 user nova-compute[75215]:         </nova:port>
Nov 29 14:53:34 user nova-compute[75215]:       </nova:ports>
Nov 29 14:53:34 user nova-compute[75215]:     </nova:instance>
Nov 29 14:53:34 user nova-compute[75215]:   </metadata>
Nov 29 14:53:34 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:53:34 user nova-compute[75215]:     <system>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="serial">793c33dc-7213-4c2f-b419-bf15a1713c6e</entry>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="uuid">793c33dc-7213-4c2f-b419-bf15a1713c6e</entry>
Nov 29 14:53:34 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:53:34 user nova-compute[75215]:     </system>
Nov 29 14:53:34 user nova-compute[75215]:   </sysinfo>
Nov 29 14:53:34 user nova-compute[75215]:   <os>
Nov 29 14:53:34 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:53:34 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:53:34 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:53:34 user nova-compute[75215]:   </os>
Nov 29 14:53:34 user nova-compute[75215]:   <features>
Nov 29 14:53:34 user nova-compute[75215]:     <acpi/>
Nov 29 14:53:34 user nova-compute[75215]:     <apic/>
Nov 29 14:53:34 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:53:34 user nova-compute[75215]:   </features>
Nov 29 14:53:34 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:53:34 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:53:34 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:53:34 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:53:34 user nova-compute[75215]:   </clock>
Nov 29 14:53:34 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:53:34 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:53:34 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:53:34 user nova-compute[75215]:   </cpu>
Nov 29 14:53:34 user nova-compute[75215]:   <devices>
Nov 29 14:53:34 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:53:34 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:53:34 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk"/>
Nov 29 14:53:34 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:53:34 user nova-compute[75215]:     </disk>
Nov 29 14:53:34 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:53:34 user nova-compute[75215]:       <mac address="fa:16:3e:e9:ff:a7"/>
Nov 29 14:53:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:34 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:53:34 user nova-compute[75215]:       <target dev="tap1f565d20-bd"/>
Nov 29 14:53:34 user nova-compute[75215]:     </interface>
Nov 29 14:53:34 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:53:34 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/console.log" append="off"/>
Nov 29 14:53:34 user nova-compute[75215]:     </serial>
Nov 29 14:53:34 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:53:34 user nova-compute[75215]:     <video>
Nov 29 14:53:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:34 user nova-compute[75215]:     </video>
Nov 29 14:53:34 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:53:34 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:53:34 user nova-compute[75215]:     </rng>
Nov 29 14:53:34 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:53:34 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:53:34 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:53:34 user nova-compute[75215]:     </memballoon>
Nov 29 14:53:34 user nova-compute[75215]:   </devices>
Nov 29 14:53:34 user nova-compute[75215]: </domain>
Nov 29 14:53:34 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2877110',id=26,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPlOIozfyLDA5Yyet+/F1GtNZgMDX6cIEK2juGbE2W7Yj5zgDql2Z7Yj8VPLBdfoIK2ZxafOBBbLJibSq7a2GTRxnvhBLegkgzsmYajFhGe0HQv2bQlNTnFwnqhWOziw==',key_name='tempest-keypair-545117171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3471da48257942a4a3882778b30ae9ba',ramdisk_id='',reservation_id='r-caj249bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54f0adb60951476ab67ad77e8b1dba1d',uuid=793c33dc-7213-4c2f-b419-bf15a1713c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converting VIF {"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG os_vif [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3e9b755-f948-5837-bf74-4e901c2bd496', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f565d20-bd, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f565d20-bd, col_values=(('qos', UUID('f2c1a5b7-0347-4046-81d5-8ea807767222')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f565d20-bd, col_values=(('external_ids', {'iface-id': '1f565d20-bdd4-4c59-919d-1455a7e8900c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:ff:a7', 'vm-uuid': '793c33dc-7213-4c2f-b419-bf15a1713c6e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: INFO os_vif [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd')
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] No VIF found with MAC fa:16:3e:e9:ff:a7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updated VIF entry in instance network info cache for port 1f565d20-bdd4-4c59-919d-1455a7e8900c. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating instance_info_cache with network_info: [{"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb2af04-ff4f-4ab2-9fd6-f05d345a8333 req-2bbbfce9-03d0-4c26-bb2d-d97a31b7de98 service nova] Releasing lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance destroyed successfully.
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c699603-de, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0544ba6d-fcb5-404c-be88-ca20ba899949) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: INFO os_vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[922407a5-1af8-4359-873e-a0ad07a17157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:53:35 user nova-compute[75215]: No targets found.
Nov 29 14:53:35 user nova-compute[75215]: iSNS:
Nov 29 14:53:35 user nova-compute[75215]: No targets found.
Nov 29 14:53:35 user nova-compute[75215]: STATIC:
Nov 29 14:53:35 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:53:35 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:35 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:35 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:53:35 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:35 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:35 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1
Nov 29 14:53:35 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:35 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:35 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5
Nov 29 14:53:35 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:35 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:35 user nova-compute[75215]: FIRMWARE:
Nov 29 14:53:35 user nova-compute[75215]: No targets found.
Nov 29 14:53:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:53:35 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:53:35 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0052de53-d733-4ac0-ad82-9d817bdc2742]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[657f167b-1bcd-449f-ab67-b8a9009dd095]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c884551b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[711a8daf-0a28-4327-8279-31b1942af90a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbd535e-582e-4b1b-98cd-39ffced63348]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b5c14-02ea-41c4-b2bf-218dda9ed6cf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d893e7-7194-4653-8646-f4f800f38864]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0ae93-70b4-42d6-9a56-135861ea385e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72546351-6711-42dd-ae31-784b84fdeb74]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:53:35 user nova-compute[75215]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ff980-946f-4542-9541-339f61cc79cf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.611s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== disconnect_volume: return (612ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Snapshot image upload complete
Nov 29 14:53:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:36 user nova-compute[75215]: INFO nova.compute.manager [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Shelve offloading
Nov 29 14:53:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance destroyed successfully.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_resize/disk /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3cc8f1be-b1d1-43fe-86be-245d44a8dcfa req-073bae77-efa7-4f0d-a245-bc374f06a848 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_migrating.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "cp -r /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_resize/disk /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk" returned: 0 in 0.341s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_resize/disk.info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk.info {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "cp -r /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_resize/disk.info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk.info" returned: 0 in 0.066s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] No waiting events found dispatching network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:36 user nova-compute[75215]: WARNING nova.compute.manager [req-9140d577-3672-4805-8f15-d720ceef4c67 req-b43ccd7d-0c41-442a-abdd-fa6304f791f2 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received unexpected event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c for instance with vm_state building and task_state spawning.
Nov 29 14:53:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance destroyed successfully.
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'resources' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfwG4b4uJiI1Qp7Xu2eqaKSPf20u0Bc1yueaialTyylMIYUIT4wQHxg3y4ubwKAALxf6HX+RyE5C4hNXygmwBIxMXPqYjnKMwLwAmRIwlaf1q2AN2Ij1fMUMKjmwhzFSQ==',key_name='tempest-keypair-1964351599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:53:35.985073',shelved_host='user',shelved_image_id='1899ee72-ac97-444d-b202-ee32877063c9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG os_vif [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd308f9fc-29, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce5392e-9715-4726-a11d-f59a06b7d834) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:37 user nova-compute[75215]: INFO os_vif [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29')
Nov 29 14:53:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Deleting instance files /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f_del
Nov 29 14:53:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Deletion of /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f_del complete
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing instance network info cache due to event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:53:37 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Deleted allocations for instance 30087951-cb13-465c-8658-93fd8f413b5f
Nov 29 14:53:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'numa_topology' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:37 user nova-compute[75215]: DEBUG nova.objects.base [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<30087951-cb13-465c-8658-93fd8f413b5f> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Port 9c699603-deba-4c85-a935-74136b77ed44 binding to destination host user is already ACTIVE {{(pid=75215) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updated VIF entry in instance network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd308f9fc-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80d11f7e-305b-4974-bc6a-51a525d1a265 req-98eff1a7-a037-4278-9d57-67c8d450903b service nova] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-64d21a76-6818-406a-bf95-9a0b344a690c tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.622s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] No waiting events found dispatching network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:38 user nova-compute[75215]: WARNING nova.compute.manager [req-3ca8807b-51c2-4417-81a9-86a05cd0f110 req-6b57ef13-0f08-44d7-9664-7fbcf990b380 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received unexpected event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c for instance with vm_state building and task_state spawning.
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:53:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Instance spawned successfully.
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:39 user nova-compute[75215]: INFO nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 29 14:53:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.utils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fa786f-8ca5-404e-910f-f90ee5d62d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18002e-9fb5-4131-8a0c-e501695b4db5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ceb8a8-bc38-405a-ad17-b169c457916b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051c0e0-e84e-48b8-a637-fc2789d6ae13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:39 user nova-compute[75215]: INFO nova.compute.manager [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Took 9.00 seconds to build instance.
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:53:39 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498da1a-13ad-442b-8651-690a6e95c87a]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG os_brick.utils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e94fdb48-e552-4522-8a97-cfdeeadf6e90 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.155s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab is timed out.
Nov 29 14:53:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab from the live domain config.
Nov 29 14:53:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlFnfKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:41 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d86775b-5f6d-4219-87c7-069e460db55e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:53:41 user nova-compute[75215]: No targets found.
Nov 29 14:53:41 user nova-compute[75215]: iSNS:
Nov 29 14:53:41 user nova-compute[75215]: No targets found.
Nov 29 14:53:41 user nova-compute[75215]: STATIC:
Nov 29 14:53:41 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:53:41 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:41 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:41 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1
Nov 29 14:53:41 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:41 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:41 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5
Nov 29 14:53:41 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:53:41 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:53:41 user nova-compute[75215]: FIRMWARE:
Nov 29 14:53:41 user nova-compute[75215]: No targets found.
Nov 29 14:53:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:53:41 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:53:41 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[920a3911-d080-43f3-9f3e-929855536e57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf613f-dfaa-4ad8-b110-f4454156a354]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:41 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:41 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 (non-flash)
Nov 29 14:53:41 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:41 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c884b0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514ede5-8e74-4e4f-a57a-5019b3b8037e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b126921-a859-49a5-9629-6fcd4c68feb6]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92535d47-6648-4292-8f19-6defa75d1804]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[272af85b-996c-450a-a3f2-d6a53272a44d]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd3274-cc31-449d-b75b-19b2819f0505]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a23c6-7bbd-4040-bd3a-5271d7a97e78]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260]
Nov 29 14:53:41 user nova-compute[75215]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3a4773-06d5-48c7-898e-589e60293bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19392349-20cd-4afb-b753-b0f9cf4436a6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== disconnect_volume: return (347ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:53:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-38e06533-7b0a-4629-8305-b74b76412075 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.976s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Starting finish_migration {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:53:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Creating image(s)
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.244s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk. size=21474836480 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk 21474836480 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk 21474836480" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start _get_guest_xml network_info=[{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '89063999-f57a-4936-a0a3-e58386e4faab', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a4d29026-19d4-4558-b8fe-a56b1bb81a1e', 'attached_at': '2023-11-29T14:53:48.000000', 'detached_at': '', 'volume_id': '6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'serial': '6ad3b9cd-e702-40d1-818f-9a7d0a032286'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:53:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:53:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:53:48 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ce62b8-e3b1-4feb-bf13-8686bdf59c2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:53:48 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c95b29-20c7-4e1b-b8f9-c626cfac8b8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added
Nov 29 14:53:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e68e4cd-f87e-4048-9181-57c87e38f921]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2acf21-3f77-4042-97c0-ab2e6b0ba5a6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5cbb5-f51b-4bbb-9408-5308186955f7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APEYijve'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc2994-0cee-4084-811f-0d4014c083af]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a331a5-5215-4cdb-80fc-8ff4beaaca1e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:48 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:48 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c1dbc-2e90-4d5c-b3af-6568e40d899d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:53:48 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:53:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a824fc75-2c5d-4562-845f-2400c7ca3096]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23c8b7-d6d5-4da8-9fc0-ff70bb4830fa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:49 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:53:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:53:49 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:53:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e3d04-13d9-4756-a3de-7f1e6a5da1e7]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:53:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:53:50 user nova-compute[75215]:   <uuid>a4d29026-19d4-4558-b8fe-a56b1bb81a1e</uuid>
Nov 29 14:53:50 user nova-compute[75215]:   <name>instance-00000014</name>
Nov 29 14:53:50 user nova-compute[75215]:   <memory>2097152</memory>
Nov 29 14:53:50 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:53:50 user nova-compute[75215]:   <metadata>
Nov 29 14:53:50 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:53:50 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherB-server-2011968674</nova:name>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:53:48</nova:creationTime>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:flavor name="m1.small">
Nov 29 14:53:50 user nova-compute[75215]:         <nova:memory>2048</nova:memory>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:disk>20</nova:disk>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:53:50 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:owner>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:user uuid="17839d64f1ee42528d08a7d00cd3159d">tempest-ServerActionsTestOtherB-291681319-project-member</nova:user>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:project uuid="2714f996f4404fd5a282aa4866064738">tempest-ServerActionsTestOtherB-291681319</nova:project>
Nov 29 14:53:50 user nova-compute[75215]:       </nova:owner>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:53:50 user nova-compute[75215]:       <nova:ports>
Nov 29 14:53:50 user nova-compute[75215]:         <nova:port uuid="9c699603-deba-4c85-a935-74136b77ed44">
Nov 29 14:53:50 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:53:50 user nova-compute[75215]:         </nova:port>
Nov 29 14:53:50 user nova-compute[75215]:       </nova:ports>
Nov 29 14:53:50 user nova-compute[75215]:     </nova:instance>
Nov 29 14:53:50 user nova-compute[75215]:   </metadata>
Nov 29 14:53:50 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:53:50 user nova-compute[75215]:     <system>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="serial">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="uuid">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:53:50 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:53:50 user nova-compute[75215]:     </system>
Nov 29 14:53:50 user nova-compute[75215]:   </sysinfo>
Nov 29 14:53:50 user nova-compute[75215]:   <os>
Nov 29 14:53:50 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:53:50 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:53:50 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:53:50 user nova-compute[75215]:   </os>
Nov 29 14:53:50 user nova-compute[75215]:   <features>
Nov 29 14:53:50 user nova-compute[75215]:     <acpi/>
Nov 29 14:53:50 user nova-compute[75215]:     <apic/>
Nov 29 14:53:50 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:53:50 user nova-compute[75215]:   </features>
Nov 29 14:53:50 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:53:50 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:53:50 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:53:50 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:53:50 user nova-compute[75215]:   </clock>
Nov 29 14:53:50 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:53:50 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:53:50 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:53:50 user nova-compute[75215]:   </cpu>
Nov 29 14:53:50 user nova-compute[75215]:   <devices>
Nov 29 14:53:50 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:53:50 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:53:50 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk"/>
Nov 29 14:53:50 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:53:50 user nova-compute[75215]:     </disk>
Nov 29 14:53:50 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:53:50 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:53:50 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 14:53:50 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:53:50 user nova-compute[75215]:       <serial>6ad3b9cd-e702-40d1-818f-9a7d0a032286</serial>
Nov 29 14:53:50 user nova-compute[75215]:     </disk>
Nov 29 14:53:50 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:53:50 user nova-compute[75215]:       <mac address="fa:16:3e:c6:77:67"/>
Nov 29 14:53:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:50 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:53:50 user nova-compute[75215]:       <target dev="tap9c699603-de"/>
Nov 29 14:53:50 user nova-compute[75215]:     </interface>
Nov 29 14:53:50 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:53:50 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/console.log" append="off"/>
Nov 29 14:53:50 user nova-compute[75215]:     </serial>
Nov 29 14:53:50 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:53:50 user nova-compute[75215]:     <video>
Nov 29 14:53:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:53:50 user nova-compute[75215]:     </video>
Nov 29 14:53:50 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:53:50 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:53:50 user nova-compute[75215]:     </rng>
Nov 29 14:53:50 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:53:50 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:53:50 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:53:50 user nova-compute[75215]:     </memballoon>
Nov 29 14:53:50 user nova-compute[75215]:   </devices>
Nov 29 14:53:50 user nova-compute[75215]: </domain>
Nov 29 14:53:50 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-359200416-network", "vif_mac": "fa:16:3e:c6:77:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG os_vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f15b42b2-f30a-5f39-b9b1-2c58db7b35db', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c699603-de, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c699603-de, col_values=(('qos', UUID('b3d7df2c-2902-4aa5-89a8-d7e4ecdf2f57')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c699603-de, col_values=(('external_ids', {'iface-id': '9c699603-deba-4c85-a935-74136b77ed44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:77:67', 'vm-uuid': 'a4d29026-19d4-4558-b8fe-a56b1bb81a1e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:50 user nova-compute[75215]: INFO os_vif [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:53:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] No VIF found with MAC fa:16:3e:c6:77:67, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:51 user nova-compute[75215]: WARNING nova.compute.manager [req-3e7efae0-01d8-4356-98bb-e87a3774d357 req-23ebc5d4-3c5d-476e-9d77-1a4127230c3d service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_finish.
Nov 29 14:53:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:53:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance running successfully.
Nov 29 14:53:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Failed to set time: agent not configured {{(pid=75215) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c3e374a4-7fc4-4b34-8f06-3c624820f509 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] finish_migration finished successfully. {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:53:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:53:53 user nova-compute[75215]: WARNING nova.compute.manager [req-3c49f847-170f-4fff-87b9-8067191b9e53 req-bd6c48f0-a503-4a95-b12e-f081be6d633b service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state resize_finish.
Nov 29 14:53:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:53:59 user nova-compute[75215]: INFO nova.compute.manager [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Unrescuing
Nov 29 14:53:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'flavor' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:53:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:00 user nova-compute[75215]: WARNING nova.compute.manager [req-0d271b11-21e3-4477-a76a-77461974ea76 req-5c0f2a48-08fb-4dae-83e5-be582297ff26 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance destroyed successfully.
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:54:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:01 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:02 user nova-compute[75215]: WARNING nova.compute.manager [req-edb6b6d5-c0dd-4f4b-b931-4cc9c1bbbd70 req-82ac53ae-9054-4af6-a62d-12fb813bcccb service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:04 user nova-compute[75215]: WARNING nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:04 user nova-compute[75215]: WARNING nova.compute.manager [req-3ad2536a-18f9-4ca1-8d4d-4c731e8b6c2b req-6d3403ca-7a0f-4f45-9a26-3a812374325a service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3cb24735-a463-4a35-ae35-c0808e394620 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7589MB free_disk=24.871437072753906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Applying migration context for instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e as it has an incoming, in-progress migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0. Migration status is finished {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 14:54:08 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating resource usage from migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0
Nov 29 14:54:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 27e9c891-3fb0-424a-b6b1-22a123c18271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 793c33dc-7213-4c2f-b419-bf15a1713c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:10 user nova-compute[75215]: INFO nova.compute.manager [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Terminating instance
Nov 29 14:54:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Instance destroyed successfully.
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'resources' on Instance uuid 5ce57ec1-587f-4d44-bce2-46cc4b4554ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363393676',display_name='tempest-AttachVolumeNegativeTest-server-1363393676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363393676',id=17,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBSX2xiZCxXbMRbMFlR1j0Au3W6ybJFNFKZK6BKl04zZ2wikQfF3/gwa2c092/Zhh1hqyeSqHYn30yyJQ2hnfYzy/E5Rtql2SPE3ok0lee4uUbEczTfxti6K6gkeBNvYQ==',key_name='tempest-keypair-1798030685',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:48:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-o3kfkejj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=5ce57ec1-587f-4d44-bce2-46cc4b4554ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "address": "fa:16:3e:24:d8:c5", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8343a72-9a", "ovs_interfaceid": "a8343a72-9a9d-41cb-a5ee-23858483aae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG os_vif [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8343a72-9a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1f43589-8f78-4816-a312-7d7c92ad04d6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:11 user nova-compute[75215]: INFO os_vif [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=a8343a72-9a9d-41cb-a5ee-23858483aae3,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8343a72-9a')
Nov 29 14:54:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Deleting instance files /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab_del
Nov 29 14:54:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Deletion of /opt/stack/data/nova/instances/5ce57ec1-587f-4d44-bce2-46cc4b4554ab_del complete
Nov 29 14:54:11 user nova-compute[75215]: INFO nova.compute.manager [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 14:54:11 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:54:11 user nova-compute[75215]: INFO nova.compute.claims [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Claim successful on node user
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:54:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.policy [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49aba78eccc74f9fa31f33a8199d3aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6bb0db9ad84e11b601e33faec86430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:54:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Creating image(s)
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "/opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "/opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:12 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Took 1.08 seconds to deallocate network for instance.
Nov 29 14:54:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b192db9-88ba-4005-90bf-417523dbcf1b req-196092e4-dce7-4cbe-a39e-d30f073f78b0 service nova] [instance: 5ce57ec1-587f-4d44-bce2-46cc4b4554ab] Received event network-vif-deleted-a8343a72-9a9d-41cb-a5ee-23858483aae3 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Successfully created port: e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Cannot resize image /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Ensure instance console log exists: /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.727s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:13 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Deleted allocations for instance 5ce57ec1-587f-4d44-bce2-46cc4b4554ab
Nov 29 14:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f7b34219-2648-420a-bb43-a3c57bbaed51 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "5ce57ec1-587f-4d44-bce2-46cc4b4554ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Successfully updated port: e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquired lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Updating instance_info_cache with network_info: [{"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Releasing lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Instance network_info: |[{"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Start _get_guest_xml network_info=[{"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:54:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235848862',display_name='tempest-VolumesActionsTest-instance-235848862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235848862',id=27,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-sxpl394v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:54:13Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=c9538833-b02d-4cf7-ad9e-b2b34eb77521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lazy-loading 'pci_devices' on Instance uuid c9538833-b02d-4cf7-ad9e-b2b34eb77521 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:54:14 user nova-compute[75215]:   <uuid>c9538833-b02d-4cf7-ad9e-b2b34eb77521</uuid>
Nov 29 14:54:14 user nova-compute[75215]:   <name>instance-0000001b</name>
Nov 29 14:54:14 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:54:14 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:54:14 user nova-compute[75215]:   <metadata>
Nov 29 14:54:14 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:54:14 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-235848862</nova:name>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:54:14</nova:creationTime>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:54:14 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:54:14 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:owner>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:user uuid="49aba78eccc74f9fa31f33a8199d3aff">tempest-VolumesActionsTest-1497530955-project-member</nova:user>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:project uuid="ce6bb0db9ad84e11b601e33faec86430">tempest-VolumesActionsTest-1497530955</nova:project>
Nov 29 14:54:14 user nova-compute[75215]:       </nova:owner>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:54:14 user nova-compute[75215]:       <nova:ports>
Nov 29 14:54:14 user nova-compute[75215]:         <nova:port uuid="e37ab787-263e-4d93-9590-96f7fa076741">
Nov 29 14:54:14 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:54:14 user nova-compute[75215]:         </nova:port>
Nov 29 14:54:14 user nova-compute[75215]:       </nova:ports>
Nov 29 14:54:14 user nova-compute[75215]:     </nova:instance>
Nov 29 14:54:14 user nova-compute[75215]:   </metadata>
Nov 29 14:54:14 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:54:14 user nova-compute[75215]:     <system>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="serial">c9538833-b02d-4cf7-ad9e-b2b34eb77521</entry>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="uuid">c9538833-b02d-4cf7-ad9e-b2b34eb77521</entry>
Nov 29 14:54:14 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:54:14 user nova-compute[75215]:     </system>
Nov 29 14:54:14 user nova-compute[75215]:   </sysinfo>
Nov 29 14:54:14 user nova-compute[75215]:   <os>
Nov 29 14:54:14 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:54:14 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:54:14 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:54:14 user nova-compute[75215]:   </os>
Nov 29 14:54:14 user nova-compute[75215]:   <features>
Nov 29 14:54:14 user nova-compute[75215]:     <acpi/>
Nov 29 14:54:14 user nova-compute[75215]:     <apic/>
Nov 29 14:54:14 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:54:14 user nova-compute[75215]:   </features>
Nov 29 14:54:14 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:54:14 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:54:14 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:54:14 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:54:14 user nova-compute[75215]:   </clock>
Nov 29 14:54:14 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:54:14 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:54:14 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:54:14 user nova-compute[75215]:   </cpu>
Nov 29 14:54:14 user nova-compute[75215]:   <devices>
Nov 29 14:54:14 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:54:14 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:54:14 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk"/>
Nov 29 14:54:14 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:54:14 user nova-compute[75215]:     </disk>
Nov 29 14:54:14 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:54:14 user nova-compute[75215]:       <mac address="fa:16:3e:b0:b2:5e"/>
Nov 29 14:54:14 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:54:14 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:54:14 user nova-compute[75215]:       <target dev="tape37ab787-26"/>
Nov 29 14:54:14 user nova-compute[75215]:     </interface>
Nov 29 14:54:14 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:54:14 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/console.log" append="off"/>
Nov 29 14:54:14 user nova-compute[75215]:     </serial>
Nov 29 14:54:14 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:54:14 user nova-compute[75215]:     <video>
Nov 29 14:54:14 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:54:14 user nova-compute[75215]:     </video>
Nov 29 14:54:14 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:54:14 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:54:14 user nova-compute[75215]:     </rng>
Nov 29 14:54:14 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:54:14 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:54:14 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:54:14 user nova-compute[75215]:     </memballoon>
Nov 29 14:54:14 user nova-compute[75215]:   </devices>
Nov 29 14:54:14 user nova-compute[75215]: </domain>
Nov 29 14:54:14 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235848862',display_name='tempest-VolumesActionsTest-instance-235848862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235848862',id=27,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-sxpl394v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:54:13Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=c9538833-b02d-4cf7-ad9e-b2b34eb77521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG os_vif [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b62e4555-8d27-52a0-80db-b058d4a9ba1f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape37ab787-26, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape37ab787-26, col_values=(('qos', UUID('abaa22a6-3f60-41a9-afae-e4105c7125cd')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape37ab787-26, col_values=(('external_ids', {'iface-id': 'e37ab787-263e-4d93-9590-96f7fa076741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:b2:5e', 'vm-uuid': 'c9538833-b02d-4cf7-ad9e-b2b34eb77521'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:14 user nova-compute[75215]: INFO os_vif [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26')
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] No VIF found with MAC fa:16:3e:b0:b2:5e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-changed-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Refreshing instance network info cache due to event network-changed-e37ab787-263e-4d93-9590-96f7fa076741. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] Acquiring lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] Acquired lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:54:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Refreshing network info cache for port e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:54:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Updated VIF entry in instance network info cache for port e37ab787-263e-4d93-9590-96f7fa076741. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:54:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Updating instance_info_cache with network_info: [{"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ea34240-9fb6-436e-8821-dc8b4e920b72 req-69a79e0a-d74b-4fc1-bd6f-b9e06ecac9dd service nova] Releasing lock "refresh_cache-c9538833-b02d-4cf7-ad9e-b2b34eb77521" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] No waiting events found dispatching network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:16 user nova-compute[75215]: WARNING nova.compute.manager [req-04ed14d4-0e21-409b-a362-3be77345cc28 req-1a2d87ee-893c-417f-a917-94cce3ba7b9c service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received unexpected event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 for instance with vm_state building and task_state spawning.
Nov 29 14:54:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:54:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Instance spawned successfully.
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] No waiting events found dispatching network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:18 user nova-compute[75215]: WARNING nova.compute.manager [req-5dc1bd85-3f61-410f-9d4a-b6176e26b064 req-eddd71f6-23f7-49f2-b662-3ec46145f7d3 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received unexpected event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 for instance with vm_state building and task_state spawning.
Nov 29 14:54:18 user nova-compute[75215]: INFO nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 29 14:54:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:54:18 user nova-compute[75215]: INFO nova.compute.manager [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Took 7.02 seconds to build instance.
Nov 29 14:54:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-afd52e91-b39a-4569-b144-55c3f54720ac tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.144s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:32 user nova-compute[75215]: INFO nova.compute.manager [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Rescuing
Nov 29 14:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:54:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:33 user nova-compute[75215]: WARNING nova.compute.manager [req-abf74fba-c60e-40e9-9aa6-05ef629c0259 req-dd7615c8-3643-45b7-8965-00efb37c453e service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state active and task_state rescuing.
Nov 29 14:54:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance destroyed successfully.
Nov 29 14:54:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Attempting a stable device rescue
Nov 29 14:54:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:54:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Creating image(s)
Nov 29 14:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'trusted_certs' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG nova.virt.images [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] f5be728e-5142-4dbc-a6ee-ea97c000f0d6 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.part /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:35 user nova-compute[75215]: WARNING nova.compute.manager [req-49b28873-2a69-44d7-8fc1-b55cfd334ddd req-af3e69d6-91da-4469-95bf-9b13804a0bae service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state active and task_state rescuing.
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.part /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.converted" returned: 0 in 0.732s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.192s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93 --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93,backing_fmt=raw /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93,backing_fmt=raw /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "c6f7a582528dbf1ef409d8730b0bab36f7a37e93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'migration_context' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<ec51da57-b873-4e98-8267-e0d72c5e9097> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start _get_guest_xml network_info=[{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:09:0a:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5be728e-5142-4dbc-a6ee-ea97c000f0d6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd269f79a-ed8d-4ae0-84ae-a58225dc7e01', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ec51da57-b873-4e98-8267-e0d72c5e9097', 'attached_at': '', 'detached_at': '', 'volume_id': 'e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'serial': 'e683dc5b-716b-409a-9ae9-747f3a90fe0f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<ec51da57-b873-4e98-8267-e0d72c5e9097> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'numa_topology' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<ec51da57-b873-4e98-8267-e0d72c5e9097> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:54:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<ec51da57-b873-4e98-8267-e0d72c5e9097> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:54:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:54:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:54:36 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[535d71a3-afb4-48dc-b65d-628e787e0135]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RVqLveGA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 14:54:36 user nova-compute[75215]: node.name = iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:54:36 user nova-compute[75215]: node.tpgt = -1
Nov 29 14:54:36 user nova-compute[75215]: node.startup = automatic
Nov 29 14:54:36 user nova-compute[75215]: node.leading_login = No
Nov 29 14:54:36 user nova-compute[75215]: iface.iscsi_ifacename = default
Nov 29 14:54:36 user nova-compute[75215]: iface.net_ifacename = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.ipaddress = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.prefix_len = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.hwaddress = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.transport_name = tcp
Nov 29 14:54:36 user nova-compute[75215]: iface.initiatorname = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.vlan_id = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.vlan_priority = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.vlan_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.iface_num = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.mtu = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.port = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.bootproto = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.subnet_mask = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.gateway = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_alt_client_id = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_dns = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_learn_iqn = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_vendor_id_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_vendor_id = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.dhcp_slp_da = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.fragmentation = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.gratuitous_arp = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.incoming_forwarding = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.tos_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.tos = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.ttl = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.delayed_ack = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.tcp_nagle = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.tcp_wsf_state = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.tcp_wsf = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.tcp_timer_scale = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.tcp_timestamp = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.redirect = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.def_task_mgmt_timeout = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.header_digest = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.data_digest = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.immediate_data = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.initial_r2t = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.data_seq_inorder = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.data_pdu_inorder = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.erl = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.max_receive_data_len = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.first_burst_len = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.max_outstanding_r2t = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.max_burst_len = 0
Nov 29 14:54:36 user nova-compute[75215]: iface.chap_auth = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.bidi_chap = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.strict_login_compliance = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.discovery_auth = <empty>
Nov 29 14:54:36 user nova-compute[75215]: iface.discovery_logout = <empty>
Nov 29 14:54:36 user nova-compute[75215]: node.discovery_address = <empty>
Nov 29 14:54:36 user nova-compute[75215]: node.discovery_port = 0
Nov 29 14:54:36 user nova-compute[75215]: node.discovery_type = static
Nov 29 14:54:36 user nova-compute[75215]: node.session.initial_cmdsn = 0
Nov 29 14:54:36 user nova-compute[75215]: node.session.initial_login_retry_max = 8
Nov 29 14:54:36 user nova-compute[75215]: node.session.xmit_thread_priority = -20
Nov 29 14:54:36 user nova-compute[75215]: node.session.cmds_max = 128
Nov 29 14:54:36 user nova-compute[75215]: node.session.queue_depth = 32
Nov 29 14:54:36 user nova-compute[75215]: node.session.nr_sessions = 1
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.authmethod = CHAP
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.username = RVqLveGA
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.password = ***
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.username_in = <empty>
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.password_in = <empty>
Nov 29 14:54:36 user nova-compute[75215]: node.session.auth.chap_algs = MD5
Nov 29 14:54:36 user nova-compute[75215]: node.session.timeo.replacement_timeout = 120
Nov 29 14:54:36 user nova-compute[75215]: node.session.err_timeo.abort_timeout = 15
Nov 29 14:54:36 user nova-compute[75215]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 14:54:36 user nova-compute[75215]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 14:54:36 user nova-compute[75215]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.FastAbort = Yes
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.InitialR2T = No
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.ImmediateData = Yes
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.MaxConnections = 1
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 14:54:36 user nova-compute[75215]: node.session.iscsi.ERL = 0
Nov 29 14:54:36 user nova-compute[75215]: node.session.scan = manual
Nov 29 14:54:36 user nova-compute[75215]: node.session.reopen_max = 0
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].address = 172.16.0.220
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].port = 3260
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].startup = manual
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].tcp.window_size = 524288
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].tcp.type_of_service = 0
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].timeo.logout_timeout = 15
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].timeo.login_timeout = 15
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].timeo.auth_timeout = 45
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.DataDigest = None
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.IFMarker = No
Nov 29 14:54:36 user nova-compute[75215]: node.conn[0].iscsi.OFMarker = No
Nov 29 14:54:36 user nova-compute[75215]: # END RECORD
Nov 29 14:54:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d014717-9d1d-427a-8e56-8265f256b19c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de0458-6f11-438b-bbe2-8d8afab428a9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVqLveGA {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVqLveGA" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[800b1ce7-7ebc-4d12-b034-90523d126476]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVqLveGA'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95ca14-aab9-43f7-a4bf-9ed73d07d50a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a8e657-db70-4910-aa04-35666de531a1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:54:36 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:54:36 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:54:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:54:36 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:54:36 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:54:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] HCTL ('35', '0', '0', 0) found on session 23 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff65d9-b99f-4e0a-8739-5d858dd18219]: (4, ('0 0 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching for a device in session 23 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '26135333932333936', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135333932333936', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-904665748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-904665748',id=24,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-0no060e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:53:01Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=ec51da57-b873-4e98-8267-e0d72c5e9097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:09:0a:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:09:0a:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.objects.base [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<ec51da57-b873-4e98-8267-e0d72c5e9097> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:54:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:54:36 user nova-compute[75215]:   <uuid>ec51da57-b873-4e98-8267-e0d72c5e9097</uuid>
Nov 29 14:54:36 user nova-compute[75215]:   <name>instance-00000018</name>
Nov 29 14:54:36 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:54:36 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:54:36 user nova-compute[75215]:   <metadata>
Nov 29 14:54:36 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:54:36 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-904665748</nova:name>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:54:36</nova:creationTime>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:54:36 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:54:36 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:owner>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 14:54:36 user nova-compute[75215]:       </nova:owner>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:54:36 user nova-compute[75215]:       <nova:ports>
Nov 29 14:54:36 user nova-compute[75215]:         <nova:port uuid="dff7cc4b-4afd-49ef-86e2-c53aff50a838">
Nov 29 14:54:36 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 14:54:36 user nova-compute[75215]:         </nova:port>
Nov 29 14:54:36 user nova-compute[75215]:       </nova:ports>
Nov 29 14:54:36 user nova-compute[75215]:     </nova:instance>
Nov 29 14:54:36 user nova-compute[75215]:   </metadata>
Nov 29 14:54:36 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:54:36 user nova-compute[75215]:     <system>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="serial">ec51da57-b873-4e98-8267-e0d72c5e9097</entry>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="uuid">ec51da57-b873-4e98-8267-e0d72c5e9097</entry>
Nov 29 14:54:36 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:54:36 user nova-compute[75215]:     </system>
Nov 29 14:54:36 user nova-compute[75215]:   </sysinfo>
Nov 29 14:54:36 user nova-compute[75215]:   <os>
Nov 29 14:54:36 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:54:36 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:54:36 user nova-compute[75215]:   </os>
Nov 29 14:54:36 user nova-compute[75215]:   <features>
Nov 29 14:54:36 user nova-compute[75215]:     <acpi/>
Nov 29 14:54:36 user nova-compute[75215]:     <apic/>
Nov 29 14:54:36 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:54:36 user nova-compute[75215]:   </features>
Nov 29 14:54:36 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:54:36 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:54:36 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:54:36 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:54:36 user nova-compute[75215]:   </clock>
Nov 29 14:54:36 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:54:36 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:54:36 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:54:36 user nova-compute[75215]:   </cpu>
Nov 29 14:54:36 user nova-compute[75215]:   <devices>
Nov 29 14:54:36 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:54:36 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:54:36 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 14:54:36 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:54:36 user nova-compute[75215]:       <serial>e683dc5b-716b-409a-9ae9-747f3a90fe0f</serial>
Nov 29 14:54:36 user nova-compute[75215]:     </disk>
Nov 29 14:54:36 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:54:36 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:54:36 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue"/>
Nov 29 14:54:36 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:54:36 user nova-compute[75215]:       <boot order="1"/>
Nov 29 14:54:36 user nova-compute[75215]:     </disk>
Nov 29 14:54:36 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:54:36 user nova-compute[75215]:       <mac address="fa:16:3e:09:0a:2b"/>
Nov 29 14:54:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:54:36 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:54:36 user nova-compute[75215]:       <target dev="tapdff7cc4b-4a"/>
Nov 29 14:54:36 user nova-compute[75215]:     </interface>
Nov 29 14:54:36 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:54:36 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/console.log" append="off"/>
Nov 29 14:54:36 user nova-compute[75215]:     </serial>
Nov 29 14:54:36 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:54:36 user nova-compute[75215]:     <video>
Nov 29 14:54:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:54:36 user nova-compute[75215]:     </video>
Nov 29 14:54:36 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:54:36 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:54:36 user nova-compute[75215]:     </rng>
Nov 29 14:54:36 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:54:36 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:54:36 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:54:36 user nova-compute[75215]:     </memballoon>
Nov 29 14:54:36 user nova-compute[75215]:   </devices>
Nov 29 14:54:36 user nova-compute[75215]: </domain>
Nov 29 14:54:36 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:54:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance destroyed successfully.
Nov 29 14:54:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:54:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:54:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:09:0a:2b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:38 user nova-compute[75215]: WARNING nova.compute.manager [req-fb14d63d-0535-4cad-8096-43fa2bacc22b req-89e562e9-53ac-4364-9967-1cba61f1e173 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state active and task_state rescuing.
Nov 29 14:54:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-85bbf9f9-93a1-4d73-851b-6a3951b3ea9a tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:54:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:54:40 user nova-compute[75215]: WARNING nova.compute.manager [req-fb854534-6e12-469d-bc12-c0f6c264160b req-61e10cbe-9fd5-46ca-bdab-e1b32c0f6ec8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state rescued and task_state None.
Nov 29 14:54:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:54:50 user nova-compute[75215]: INFO nova.compute.manager [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Detaching volume c152f15a-bb2f-471b-ba94-dd8ad59844f5
Nov 29 14:54:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Attempting to driver detach volume c152f15a-bb2f-471b-ba94-dd8ad59844f5 from mountpoint /dev/vdb
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Attempting to detach device vdb from instance 25d981de-63c5-4012-8f38-fca174d1f3f7 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:54:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:54:50 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:54:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:54:50 user nova-compute[75215]:   <serial>c152f15a-bb2f-471b-ba94-dd8ad59844f5</serial>
Nov 29 14:54:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:54:50 user nova-compute[75215]: </disk>
Nov 29 14:54:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:54:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdb from instance 25d981de-63c5-4012-8f38-fca174d1f3f7 from the persistent domain config.
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25d981de-63c5-4012-8f38-fca174d1f3f7 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:54:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:54:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:54:50 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 14:54:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:54:50 user nova-compute[75215]:   <serial>c152f15a-bb2f-471b-ba94-dd8ad59844f5</serial>
Nov 29 14:54:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:54:50 user nova-compute[75215]: </disk>
Nov 29 14:54:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:54:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:54:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:54:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:54:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:54:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-changed-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Refreshing instance network info cache due to event network-changed-85b5aaa0-3670-49a7-9244-6d1fb48ff135. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] Acquiring lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] Acquired lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Refreshing network info cache for port 85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updated VIF entry in instance network info cache for port 85b5aaa0-3670-49a7-9244-6d1fb48ff135. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating instance_info_cache with network_info: [{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'flavor' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2d1e8cc-34dc-4655-be04-78cacc86d4da req-b7a86c91-6a35-46ba-80d2-e45732634736 service nova] Releasing lock "refresh_cache-27e9c891-3fb0-424a-b6b1-22a123c18271" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:01 user nova-compute[75215]: INFO nova.compute.manager [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attaching volume b4326ca7-174a-483f-9ef7-451b705bbc4e to /dev/vdb
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.utils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[041822b8-f006-47b0-b3e0-7dae5917ddd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc234b0-e84f-4a93-9529-3feb049713bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5cd8b-8ab5-4759-b192-1bc66f5e4997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[571638e9-8396-4898-a99d-cd07fe3399d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:01 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b540661d-6cc4-4c5f-961f-9df8c059257c]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG os_brick.utils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating existing volume attachment record: 397ab9e4-068c-4372-8786-095e4f6e563f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=24.77004623413086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Applying migration context for instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e as it has an incoming, in-progress migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0. Migration status is finished {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 14:55:05 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating resource usage from migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0
Nov 29 14:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 27e9c891-3fb0-424a-b6b1-22a123c18271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 793c33dc-7213-4c2f-b419-bf15a1713c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance c9538833-b02d-4cf7-ad9e-b2b34eb77521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 14:55:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.550s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:55:06 user nova-compute[75215]: INFO nova.compute.claims [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Claim successful on node user
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:55:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.policy [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd88477198b5d411f9e193afdb9f40e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e6a6477d6b4664a2f0de1b0bdc15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:55:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Creating image(s)
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "/opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk 1073741824" returned: 0 in 0.062s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Successfully created port: 2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Cannot resize image /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Ensure instance console log exists: /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Successfully updated port: 2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquired lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-changed-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Refreshing instance network info cache due to event network-changed-2c36b828-a881-4bde-8076-9eec4e3eec2b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] Acquiring lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updating instance_info_cache with network_info: [{"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Releasing lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Instance network_info: |[{"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] Acquired lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Refreshing network info cache for port 2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Start _get_guest_xml network_info=[{"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:55:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2103859116',display_name='tempest-AttachVolumeNegativeTest-server-2103859116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2103859116',id=28,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7xC70v0AYlDYYd0MOur9CUyPSoO0hIW22MeQT7j6otux6uRnZRSGWrCu1p1TOmTx7TwhoMJAeUhrtyHbXFKh1Jy7730L8Sxx0BHAOC8tAXXtvBhKHzVOLF+iQl5H2Z/w==',key_name='tempest-keypair-449157508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7i0qzq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'pci_devices' on Instance uuid b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:55:08 user nova-compute[75215]:   <uuid>b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4</uuid>
Nov 29 14:55:08 user nova-compute[75215]:   <name>instance-0000001c</name>
Nov 29 14:55:08 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:55:08 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:55:08 user nova-compute[75215]:   <metadata>
Nov 29 14:55:08 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:55:08 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2103859116</nova:name>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:55:08</nova:creationTime>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:55:08 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:55:08 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:owner>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:user uuid="d88477198b5d411f9e193afdb9f40e03">tempest-AttachVolumeNegativeTest-1682890616-project-member</nova:user>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:project uuid="35e6a6477d6b4664a2f0de1b0bdc15e2">tempest-AttachVolumeNegativeTest-1682890616</nova:project>
Nov 29 14:55:08 user nova-compute[75215]:       </nova:owner>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:55:08 user nova-compute[75215]:       <nova:ports>
Nov 29 14:55:08 user nova-compute[75215]:         <nova:port uuid="2c36b828-a881-4bde-8076-9eec4e3eec2b">
Nov 29 14:55:08 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 14:55:08 user nova-compute[75215]:         </nova:port>
Nov 29 14:55:08 user nova-compute[75215]:       </nova:ports>
Nov 29 14:55:08 user nova-compute[75215]:     </nova:instance>
Nov 29 14:55:08 user nova-compute[75215]:   </metadata>
Nov 29 14:55:08 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:55:08 user nova-compute[75215]:     <system>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="serial">b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4</entry>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="uuid">b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4</entry>
Nov 29 14:55:08 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:55:08 user nova-compute[75215]:     </system>
Nov 29 14:55:08 user nova-compute[75215]:   </sysinfo>
Nov 29 14:55:08 user nova-compute[75215]:   <os>
Nov 29 14:55:08 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:55:08 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:55:08 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:55:08 user nova-compute[75215]:   </os>
Nov 29 14:55:08 user nova-compute[75215]:   <features>
Nov 29 14:55:08 user nova-compute[75215]:     <acpi/>
Nov 29 14:55:08 user nova-compute[75215]:     <apic/>
Nov 29 14:55:08 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:55:08 user nova-compute[75215]:   </features>
Nov 29 14:55:08 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:55:08 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:55:08 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:55:08 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:55:08 user nova-compute[75215]:   </clock>
Nov 29 14:55:08 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:55:08 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:55:08 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:55:08 user nova-compute[75215]:   </cpu>
Nov 29 14:55:08 user nova-compute[75215]:   <devices>
Nov 29 14:55:08 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:55:08 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:55:08 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk"/>
Nov 29 14:55:08 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:55:08 user nova-compute[75215]:     </disk>
Nov 29 14:55:08 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:55:08 user nova-compute[75215]:       <mac address="fa:16:3e:99:00:e6"/>
Nov 29 14:55:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:08 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:55:08 user nova-compute[75215]:       <target dev="tap2c36b828-a8"/>
Nov 29 14:55:08 user nova-compute[75215]:     </interface>
Nov 29 14:55:08 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:55:08 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/console.log" append="off"/>
Nov 29 14:55:08 user nova-compute[75215]:     </serial>
Nov 29 14:55:08 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:55:08 user nova-compute[75215]:     <video>
Nov 29 14:55:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:08 user nova-compute[75215]:     </video>
Nov 29 14:55:08 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:55:08 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:55:08 user nova-compute[75215]:     </rng>
Nov 29 14:55:08 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:55:08 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:55:08 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:55:08 user nova-compute[75215]:     </memballoon>
Nov 29 14:55:08 user nova-compute[75215]:   </devices>
Nov 29 14:55:08 user nova-compute[75215]: </domain>
Nov 29 14:55:08 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2103859116',display_name='tempest-AttachVolumeNegativeTest-server-2103859116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2103859116',id=28,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7xC70v0AYlDYYd0MOur9CUyPSoO0hIW22MeQT7j6otux6uRnZRSGWrCu1p1TOmTx7TwhoMJAeUhrtyHbXFKh1Jy7730L8Sxx0BHAOC8tAXXtvBhKHzVOLF+iQl5H2Z/w==',key_name='tempest-keypair-449157508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7i0qzq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG os_vif [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd21365-5613-5cd0-b7c2-d747c214d436', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c36b828-a8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c36b828-a8, col_values=(('qos', UUID('071d7d67-07d1-4215-ad51-1e9d6c1b1a25')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c36b828-a8, col_values=(('external_ids', {'iface-id': '2c36b828-a881-4bde-8076-9eec4e3eec2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:00:e6', 'vm-uuid': 'b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: INFO os_vif [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8')
Nov 29 14:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:99:00:e6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updated VIF entry in instance network info cache for port 2c36b828-a881-4bde-8076-9eec4e3eec2b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updating instance_info_cache with network_info: [{"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1afae77-5dee-4b4b-8c9c-139a145dbf5c req-8fc21fe7-5ede-4385-8c6e-3aa5bcd629a3 service nova] Releasing lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:09 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fdd801-5f59-4548-a162-aea2a669d810]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:55:09 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5327b7-4741-44c5-92a7-ad541751e600]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e] added
Nov 29 14:55:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4476c130-4c89-43cc-8463-0db8d93fb287]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb853d8-9cfb-456e-8634-e7764c7fd459]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKYvlcuZ {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKYvlcuZ" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b0fbd-67f5-416d-998a-5520f0c3e4d6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKYvlcuZ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c57eb-24c8-44ba-96dd-0bfef4725830]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba979b0-b27f-4525-b777-fcb1abd0d48f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] No waiting events found dispatching network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:10 user nova-compute[75215]: WARNING nova.compute.manager [req-ebce4a21-99f2-4200-a31f-b15fb85d7f9c req-fad5a907-e3a6-44e8-a889-ffdc33664159 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received unexpected event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b for instance with vm_state building and task_state spawning.
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed603b-9763-4d3e-bfd0-1dfb4d1c1791]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]
Nov 29 14:55:10 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56164b-d5a0-49a6-b8a7-631962056610]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4dafe3-2e71-40a6-b1d3-14d4934d546f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:10 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb06c2bf-1a79-459b-83ef-44ed08c9aacd]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25d981de-63c5-4012-8f38-fca174d1f3f7 is timed out.
Nov 29 14:55:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdb from instance 25d981de-63c5-4012-8f38-fca174d1f3f7 from the live domain config.
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXOUBHWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23338616532333336', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338616532333336', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.032s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'flavor' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03475df8-96fb-4a25-833b-20c79903b309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:55:11 user nova-compute[75215]: No targets found.
Nov 29 14:55:11 user nova-compute[75215]: iSNS:
Nov 29 14:55:11 user nova-compute[75215]: No targets found.
Nov 29 14:55:11 user nova-compute[75215]: STATIC:
Nov 29 14:55:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:55:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:55:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:55:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5
Nov 29 14:55:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:11 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:11 user nova-compute[75215]: FIRMWARE:
Nov 29 14:55:11 user nova-compute[75215]: No targets found.
Nov 29 14:55:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:55:11 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:55:11 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:55:11 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:11 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:55:11 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:55:11 user nova-compute[75215]:   <serial>b4326ca7-174a-483f-9ef7-451b705bbc4e</serial>
Nov 29 14:55:11 user nova-compute[75215]: </disk>
Nov 29 14:55:11 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[009e691c-1e5d-4df8-b4dc-b077d8500184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[531f7024-616a-40a2-87c6-f1c97e04545f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:11 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c8835cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4136a7-cb5e-4f0e-9a03-45da5c2ce2a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e552aca3-0abd-4d92-85bf-59f08e0cbf8a]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e08f64-bb09-44e4-b1e9-6bd7c660b869]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622c1cb-21b8-4eb0-91dc-058d0399adb0]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b4093e-934f-45c7-a127-b4e5439e14dc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b930f5-17d8-469e-8c21-7631c10f86d5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260]
Nov 29 14:55:11 user nova-compute[75215]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c152f15a-bb2f-471b-ba94-dd8ad59844f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fdf54e-2975-4d79-9b1d-bb419dcceb47]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== disconnect_volume: return (349ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:26:97:ce, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7058d53f-18f8-4b49-9fc1-54ed1c4f5cc3 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.205s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:55:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Instance spawned successfully.
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:12 user nova-compute[75215]: INFO nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 29 14:55:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] No waiting events found dispatching network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:12 user nova-compute[75215]: WARNING nova.compute.manager [req-568382cf-3e0b-45d2-b63c-fe72b6cbb81d req-69f22cab-1616-48fb-9d5d-56315fc276b3 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received unexpected event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b for instance with vm_state building and task_state spawning.
Nov 29 14:55:12 user nova-compute[75215]: INFO nova.compute.manager [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Took 6.72 seconds to build instance.
Nov 29 14:55:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-90f153a1-fa9f-498d-8753-82c74c014527 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.808s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f67eac0-39ab-4897-86ff-081f7b9c9bf9 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:13 user nova-compute[75215]: INFO nova.compute.manager [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Rebuilding instance
Nov 29 14:55:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75215) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state powering-off.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state powering-off.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state active and task_state rebuilding.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state active and task_state rebuilding.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING nova.compute.manager [req-60be683e-ce37-407b-a887-09dacbfec3b6 req-4b30e53a-b65b-4470-846a-9871583c9cd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state powering-off.
Nov 29 14:55:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance destroyed successfully.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance destroyed successfully.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2fe3fa03-9d21-4cf1-b313-883478d28239 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.243s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:14 user nova-compute[75215]: INFO nova.compute.manager [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Detaching volume b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:55:14 user nova-compute[75215]: INFO nova.virt.block_device [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attempting to driver detach volume b4326ca7-174a-483f-9ef7-451b705bbc4e from mountpoint /dev/vdb
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Attempting to detach device vdb from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:55:14 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:14 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:55:14 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:55:14 user nova-compute[75215]:   <serial>b4326ca7-174a-483f-9ef7-451b705bbc4e</serial>
Nov 29 14:55:14 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:55:14 user nova-compute[75215]: </disk>
Nov 29 14:55:14 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully detached device vdb from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the persistent domain config.
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336e14f-2393-48f3-9116-288b3abdd754]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:55:14 user nova-compute[75215]: No targets found.
Nov 29 14:55:14 user nova-compute[75215]: iSNS:
Nov 29 14:55:14 user nova-compute[75215]: No targets found.
Nov 29 14:55:14 user nova-compute[75215]: STATIC:
Nov 29 14:55:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:55:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:55:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:14 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:55:14 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:14 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:14 user nova-compute[75215]: FIRMWARE:
Nov 29 14:55:14 user nova-compute[75215]: No targets found.
Nov 29 14:55:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:55:14 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:55:14 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c263a-1d9b-4f04-833d-dfd77db58b0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e978e89-e217-4629-8ff4-5f973a6eade3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:14 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:14 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:14 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:14 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cbc180d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1947c70-e385-4cbd-924f-2d9536681d76]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353bf22-3edf-4b78-8116-2ec2ffdc7b77]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850a7f9-3c88-430f-bdd4-3bfc72154f21]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df108245-ed6a-4a50-a89f-85ce57e44969]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1bc67e-3017-410a-b157-88cf2b914b4b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7638033a-4fac-42da-a4f4-1140d7414a73]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]
Nov 29 14:55:14 user nova-compute[75215]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[932eceb2-1d30-4e69-b68f-0fa8ec9910b2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== disconnect_volume: return (365ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:55:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance destroyed successfully.
Nov 29 14:55:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-ServerActionsTestOtherA-server-2026751555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85b5aaa0-36, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42d2fa0b-adb9-4ff0-938a-7e3722be5ae6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:15 user nova-compute[75215]: INFO os_vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36')
Nov 29 14:55:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:15 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[895147c7-2719-4127-91cb-628e88310594]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:55:15 user nova-compute[75215]: No targets found.
Nov 29 14:55:15 user nova-compute[75215]: iSNS:
Nov 29 14:55:15 user nova-compute[75215]: No targets found.
Nov 29 14:55:15 user nova-compute[75215]: STATIC:
Nov 29 14:55:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:55:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:15 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:55:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:15 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:15 user nova-compute[75215]: FIRMWARE:
Nov 29 14:55:15 user nova-compute[75215]: No targets found.
Nov 29 14:55:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:55:15 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:55:15 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e08889c-432c-47a4-a268-7064e2ab48e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aace72-cb3a-4ca8-995b-c883e5c9249d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:16 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:16 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:16 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:16 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac6112d0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== disconnect_volume: return (82ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:55:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Deleting instance files /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271_del
Nov 29 14:55:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Deletion of /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271_del complete
Nov 29 14:55:16 user nova-compute[75215]: INFO nova.virt.block_device [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Booting with volume b4326ca7-174a-483f-9ef7-451b705bbc4e at /dev/vdb
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:16 user nova-compute[75215]: WARNING nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state None.
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:16 user nova-compute[75215]: WARNING nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state None.
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:16 user nova-compute[75215]: WARNING nova.compute.manager [req-52fcda59-9a80-46b1-8fbb-b3c387920dd8 req-55e1703f-7517-4c0c-afc2-295399436a57 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state None.
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc652a65-3155-4073-90aa-65a8ac7c07a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[204371f0-3ae3-4964-8e36-a5078196f9ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33d7145-157d-4c42-bbae-efab13a7a250]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cb34cc-4123-43eb-a2ce-172f3bb493e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:16 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:55:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43454de7-e33f-4a03-99c7-211f767b090b]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:16 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating existing volume attachment record: 1654edfc-0732-40a3-a620-a21f2512586c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:55:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Port 9c699603-deba-4c85-a935-74136b77ed44 binding to destination host user is already ACTIVE {{(pid=75215) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 14:55:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:55:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-changed-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Refreshing instance network info cache due to event network-changed-1f565d20-bdd4-4c59-919d-1455a7e8900c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] Acquiring lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] Acquired lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Refreshing network info cache for port 1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Creating tmpfile /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/tmpv33fvr3k to verify with other compute node that the instance is on the same shared storage. {{(pid=75215) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updated VIF entry in instance network info cache for port 1f565d20-bdd4-4c59-919d-1455a7e8900c. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating instance_info_cache with network_info: [{"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fd7cf295-2954-4b07-9137-a2a0b20b9985 req-986c1733-1534-4755-8c5b-b83b25cba4a6 service nova] Releasing lock "refresh_cache-793c33dc-7213-4c2f-b419-bf15a1713c6e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance destroyed successfully.
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'resources' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c699603-de, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3d7df2c-2902-4aa5-89a8-d7e4ecdf2f57) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:22 user nova-compute[75215]: INFO os_vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:22 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a8d8f3-7c0d-447f-8518-73211c910239]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:55:22 user nova-compute[75215]: No targets found.
Nov 29 14:55:22 user nova-compute[75215]: iSNS:
Nov 29 14:55:22 user nova-compute[75215]: No targets found.
Nov 29 14:55:22 user nova-compute[75215]: STATIC:
Nov 29 14:55:22 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:55:22 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:22 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:22 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:55:22 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:55:22 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:55:22 user nova-compute[75215]: FIRMWARE:
Nov 29 14:55:22 user nova-compute[75215]: No targets found.
Nov 29 14:55:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:55:22 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:55:22 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f796c726-98c8-4ad0-9f0f-4a3eed2d8fde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940c7c4-ceb1-44f1-826b-3489b51b2d36]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:22 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:22 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c8835dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f74234a-c848-4626-a4ea-193f845fa95d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[346e7c55-484d-47d5-9c5a-316ace0d0dff]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3541c2-6ef1-4daa-8262-2d74e2fa77b3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692728f-33da-4fcd-8d2a-b2c4c7dacffa]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ed359-ae36-414b-b12d-eab7d0d2ff49]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4b167-4144-4990-9e9f-8552708904e8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:55:22 user nova-compute[75215]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[709caa17-fe8c-4561-b34a-e2b6eeca2d2b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== disconnect_volume: return (356ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:23 user nova-compute[75215]: INFO nova.compute.manager [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Unshelving
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_requests' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'numa_topology' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:23 user nova-compute[75215]: WARNING nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state resized and task_state resize_reverting.
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:23 user nova-compute[75215]: WARNING nova.compute.manager [req-36082716-c81f-46f1-9976-e41aa32c9b5a req-794775fe-1623-4d67-b896-610b1e9256dc service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state resized and task_state resize_reverting.
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:55:23 user nova-compute[75215]: INFO nova.compute.claims [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Claim successful on node user
Nov 29 14:55:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.035s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'migration_context' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:23 user nova-compute[75215]: DEBUG nova.objects.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Object Instance<a4d29026-19d4-4558-b8fe-a56b1bb81a1e> lazy-loaded attributes: resources,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:55:23 user nova-compute[75215]: INFO nova.network.neutron [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating port d308f9fc-29b3-4820-8aea-0f43bd60c687 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.544s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:24 user nova-compute[75215]: INFO nova.compute.manager [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Swapping old allocation on dict_keys(['2212761d-64cd-4bb5-94ac-48b883e4044b']) held by migration d9473ab6-eec0-4b73-aec0-d3c4643f88f0 for instance
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:55:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Creating image(s)
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Overwriting current allocation {'allocations': {'2212761d-64cd-4bb5-94ac-48b883e4044b': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 34}}, 'project_id': '2714f996f4404fd5a282aa4866064738', 'user_id': '17839d64f1ee42528d08a7d00cd3159d', 'consumer_generation': 1} on consumer a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing instance network info cache due to event network-changed-d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] Acquiring lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk 1073741824" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:55:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Creating image(s)
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] Acquired lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Refreshing network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.objects.base [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<30087951-cb13-465c-8658-93fd8f413b5f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Cannot resize image /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Ensure instance console log exists: /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start _get_guest_xml network_info=[{"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1654edfc-0732-40a3-a620-a21f2512586c', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27e9c891-3fb0-424a-b6b1-22a123c18271', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4326ca7-174a-483f-9ef7-451b705bbc4e', 'serial': 'b4326ca7-174a-483f-9ef7-451b705bbc4e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:55:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 14:55:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.utils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670bed2-4ad4-43a6-aa35-99cf98b8b4be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:25 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:25 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:25 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82327e8-d26b-4ee3-be9f-4a3de92cd457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bd21e-fc1e-46f6-824b-bb24dcb48193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:55:26 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a1097-79ea-4abf-bfce-1b461c2d4d41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[45299966-88a6-4093-b615-0afd21d0b7d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76408f11-5cad-45df-bdd2-768099e3e6f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e] added
Nov 29 14:55:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lazy-loading 'flavor' on Instance uuid 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:26 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d062d024-dbc6-4335-b427-6b7c3289360a]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== get_connector_properties: return (1038ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f169a-d06c-4af2-8b30-7c85917e5946]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG nova.virt.images [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] 1899ee72-ac97-444d-b202-ee32877063c9 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.part /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[217db024-b67d-41a7-b2b2-00fcdaa3e177]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKYvlcuZ {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKYvlcuZ" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8780f-d0fa-4681-b5fa-bd4c249b7f1d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKYvlcuZ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.056s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4abd02-9ebc-4eb9-98de-92bf4ffc69db]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.081s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e49ebc-e9f5-4ee4-be81-5a3db34682e0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --login" returned: 0 in 0.216s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e9f916-a6d5-4a87-87b5-a78b48983855]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]
Nov 29 14:55:27 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3717b409-ab7e-4b46-8bab-cc5fbd408f63]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:27 user nova-compute[75215]: INFO nova.compute.manager [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Attaching volume ec431a72-6829-492d-b2e7-c490599b61e4 to /dev/vdb
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce46c02d-3f7a-4abd-b4b3-6df162ec9364]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:27 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:27 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:27 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.570s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.part /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.converted" returned: 0 in 0.557s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd4cd3-1071-4662-833d-77bde5ca7668]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updated VIF entry in instance network info cache for port d308f9fc-29b3-4820-8aea-0f43bd60c687. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f569710d-ea4c-44c6-bbcf-2b9444fd3b36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d00c5be-2193-4db3-a6f9-b8666860e6d0 req-d80c6c11-69a6-4e85-9977-9bc4695fa5b3 service nova] Releasing lock "refresh_cache-30087951-cb13-465c-8658-93fd8f413b5f" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7314997-33f7-4929-9501-3673b3c2fafc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e4aff-7c27-4abb-b6e1-ced7358cf5eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fa084e-f3c6-4e42-bb49-3db05013fc08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.902s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:55:27 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbed468-3f81-4ba3-ad69-b286d46d52ba]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating existing volume attachment record: 49a4b8b2-3225-4826-b48d-e30f35a6782c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155,backing_fmt=raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155,backing_fmt=raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk 1073741824" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "d310be72d8b00f197a97766e0ebebcb72c9d0155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'migration_context' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:27 user nova-compute[75215]: DEBUG nova.objects.base [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<30087951-cb13-465c-8658-93fd8f413b5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:55:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Rebasing disk image.
Nov 29 14:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.694s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== connect_volume: return (2696ms) {'type': 'block', 'scsi_wwn': '23338616532333336', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338616532333336', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c -F raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-ServerActionsTestOtherA-server-2026751555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:55:28 user nova-compute[75215]:   <uuid>27e9c891-3fb0-424a-b6b1-22a123c18271</uuid>
Nov 29 14:55:28 user nova-compute[75215]:   <name>instance-00000019</name>
Nov 29 14:55:28 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:55:28 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:55:28 user nova-compute[75215]:   <metadata>
Nov 29 14:55:28 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:55:28 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-2026751555</nova:name>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:55:25</nova:creationTime>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:55:28 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:55:28 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:owner>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:user uuid="25bf6c00d9b340c78b2e136f22b2b211">tempest-ServerActionsTestOtherA-380950315-project-member</nova:user>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:project uuid="f9445b58a3554c19b57afbffbaa6a112">tempest-ServerActionsTestOtherA-380950315</nova:project>
Nov 29 14:55:28 user nova-compute[75215]:       </nova:owner>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:55:28 user nova-compute[75215]:       <nova:ports>
Nov 29 14:55:28 user nova-compute[75215]:         <nova:port uuid="85b5aaa0-3670-49a7-9244-6d1fb48ff135">
Nov 29 14:55:28 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:55:28 user nova-compute[75215]:         </nova:port>
Nov 29 14:55:28 user nova-compute[75215]:       </nova:ports>
Nov 29 14:55:28 user nova-compute[75215]:     </nova:instance>
Nov 29 14:55:28 user nova-compute[75215]:   </metadata>
Nov 29 14:55:28 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:55:28 user nova-compute[75215]:     <system>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="serial">27e9c891-3fb0-424a-b6b1-22a123c18271</entry>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="uuid">27e9c891-3fb0-424a-b6b1-22a123c18271</entry>
Nov 29 14:55:28 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:55:28 user nova-compute[75215]:     </system>
Nov 29 14:55:28 user nova-compute[75215]:   </sysinfo>
Nov 29 14:55:28 user nova-compute[75215]:   <os>
Nov 29 14:55:28 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:55:28 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:55:28 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:55:28 user nova-compute[75215]:   </os>
Nov 29 14:55:28 user nova-compute[75215]:   <features>
Nov 29 14:55:28 user nova-compute[75215]:     <acpi/>
Nov 29 14:55:28 user nova-compute[75215]:     <apic/>
Nov 29 14:55:28 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:55:28 user nova-compute[75215]:   </features>
Nov 29 14:55:28 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:55:28 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:55:28 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:55:28 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:55:28 user nova-compute[75215]:   </clock>
Nov 29 14:55:28 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:55:28 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:55:28 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:55:28 user nova-compute[75215]:   </cpu>
Nov 29 14:55:28 user nova-compute[75215]:   <devices>
Nov 29 14:55:28 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:55:28 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:55:28 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk"/>
Nov 29 14:55:28 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:55:28 user nova-compute[75215]:     </disk>
Nov 29 14:55:28 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:55:28 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:28 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 14:55:28 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:55:28 user nova-compute[75215]:       <serial>b4326ca7-174a-483f-9ef7-451b705bbc4e</serial>
Nov 29 14:55:28 user nova-compute[75215]:     </disk>
Nov 29 14:55:28 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:55:28 user nova-compute[75215]:       <mac address="fa:16:3e:26:97:ce"/>
Nov 29 14:55:28 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:28 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:55:28 user nova-compute[75215]:       <target dev="tap85b5aaa0-36"/>
Nov 29 14:55:28 user nova-compute[75215]:     </interface>
Nov 29 14:55:28 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:55:28 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/console.log" append="off"/>
Nov 29 14:55:28 user nova-compute[75215]:     </serial>
Nov 29 14:55:28 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:55:28 user nova-compute[75215]:     <video>
Nov 29 14:55:28 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:28 user nova-compute[75215]:     </video>
Nov 29 14:55:28 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:55:28 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:55:28 user nova-compute[75215]:     </rng>
Nov 29 14:55:28 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:55:28 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:55:28 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:55:28 user nova-compute[75215]:     </memballoon>
Nov 29 14:55:28 user nova-compute[75215]:   </devices>
Nov 29 14:55:28 user nova-compute[75215]: </domain>
Nov 29 14:55:28 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-ServerActionsTestOtherA-server-2026751555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG os_vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afb3d5f4-74c9-58c6-96d4-aa5efb875ec7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85b5aaa0-36, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85b5aaa0-36, col_values=(('qos', UUID('31c2ed3e-4058-40e7-bc80-88b8845d49d2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85b5aaa0-36, col_values=(('external_ids', {'iface-id': '85b5aaa0-3670-49a7-9244-6d1fb48ff135', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:97:ce', 'vm-uuid': '27e9c891-3fb0-424a-b6b1-22a123c18271'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:28 user nova-compute[75215]: INFO os_vif [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36')
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:26:97:ce, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:30 user nova-compute[75215]: WARNING nova.compute.manager [req-cb1baa07-7d14-427f-9c91-b3b9cc159b6c req-bb30fa82-502e-4794-b4b1-4e299c33ff33 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c -F raw /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk" returned: 0 in 2.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start _get_guest_xml network_info=[{"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4a6c3217c00db08af5034720cdce6d0b',container_format='bare',created_at=2023-11-29T14:53:30Z,direct_url=<?>,disk_format='qcow2',id=1899ee72-ac97-444d-b202-ee32877063c9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1506387384-shelved',owner='bce0446252d5486794553a9cae9281af',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T14:53:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:55:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4a6c3217c00db08af5034720cdce6d0b',container_format='bare',created_at=2023-11-29T14:53:30Z,direct_url=<?>,disk_format='qcow2',id=1899ee72-ac97-444d-b202-ee32877063c9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1506387384-shelved',owner='bce0446252d5486794553a9cae9281af',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T14:53:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.objects.base [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<30087951-cb13-465c-8658-93fd8f413b5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='1899ee72-ac97-444d-b202-ee32877063c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1964351599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:53:35.985073',shelved_host='user',shelved_image_id='1899ee72-ac97-444d-b202-ee32877063c9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'pci_devices' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.objects.base [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Object Instance<30087951-cb13-465c-8658-93fd8f413b5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:55:30 user nova-compute[75215]:   <uuid>30087951-cb13-465c-8658-93fd8f413b5f</uuid>
Nov 29 14:55:30 user nova-compute[75215]:   <name>instance-00000017</name>
Nov 29 14:55:30 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:55:30 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:55:30 user nova-compute[75215]:   <metadata>
Nov 29 14:55:30 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:55:30 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1506387384</nova:name>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:55:30</nova:creationTime>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:55:30 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:55:30 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:owner>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:user uuid="21f3cbb55df1494f94e304bfc82c4c5c">tempest-AttachVolumeShelveTestJSON-1453470125-project-member</nova:user>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:project uuid="bce0446252d5486794553a9cae9281af">tempest-AttachVolumeShelveTestJSON-1453470125</nova:project>
Nov 29 14:55:30 user nova-compute[75215]:       </nova:owner>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:root type="image" uuid="1899ee72-ac97-444d-b202-ee32877063c9"/>
Nov 29 14:55:30 user nova-compute[75215]:       <nova:ports>
Nov 29 14:55:30 user nova-compute[75215]:         <nova:port uuid="d308f9fc-29b3-4820-8aea-0f43bd60c687">
Nov 29 14:55:30 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 14:55:30 user nova-compute[75215]:         </nova:port>
Nov 29 14:55:30 user nova-compute[75215]:       </nova:ports>
Nov 29 14:55:30 user nova-compute[75215]:     </nova:instance>
Nov 29 14:55:30 user nova-compute[75215]:   </metadata>
Nov 29 14:55:30 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:55:30 user nova-compute[75215]:     <system>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="serial">30087951-cb13-465c-8658-93fd8f413b5f</entry>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="uuid">30087951-cb13-465c-8658-93fd8f413b5f</entry>
Nov 29 14:55:30 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:55:30 user nova-compute[75215]:     </system>
Nov 29 14:55:30 user nova-compute[75215]:   </sysinfo>
Nov 29 14:55:30 user nova-compute[75215]:   <os>
Nov 29 14:55:30 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:55:30 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:55:30 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:55:30 user nova-compute[75215]:   </os>
Nov 29 14:55:30 user nova-compute[75215]:   <features>
Nov 29 14:55:30 user nova-compute[75215]:     <acpi/>
Nov 29 14:55:30 user nova-compute[75215]:     <apic/>
Nov 29 14:55:30 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:55:30 user nova-compute[75215]:   </features>
Nov 29 14:55:30 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:55:30 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:55:30 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:55:30 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:55:30 user nova-compute[75215]:   </clock>
Nov 29 14:55:30 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:55:30 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:55:30 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:55:30 user nova-compute[75215]:   </cpu>
Nov 29 14:55:30 user nova-compute[75215]:   <devices>
Nov 29 14:55:30 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:55:30 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:55:30 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk"/>
Nov 29 14:55:30 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:55:30 user nova-compute[75215]:     </disk>
Nov 29 14:55:30 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:55:30 user nova-compute[75215]:       <mac address="fa:16:3e:1c:ae:d6"/>
Nov 29 14:55:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:30 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:55:30 user nova-compute[75215]:       <target dev="tapd308f9fc-29"/>
Nov 29 14:55:30 user nova-compute[75215]:     </interface>
Nov 29 14:55:30 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:55:30 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/console.log" append="off"/>
Nov 29 14:55:30 user nova-compute[75215]:     </serial>
Nov 29 14:55:30 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:55:30 user nova-compute[75215]:     <video>
Nov 29 14:55:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:30 user nova-compute[75215]:     </video>
Nov 29 14:55:30 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:55:30 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:55:30 user nova-compute[75215]:     </rng>
Nov 29 14:55:30 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:55:30 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:55:30 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:55:30 user nova-compute[75215]:     </memballoon>
Nov 29 14:55:30 user nova-compute[75215]:   </devices>
Nov 29 14:55:30 user nova-compute[75215]: </domain>
Nov 29 14:55:30 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='1899ee72-ac97-444d-b202-ee32877063c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1964351599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member',shelved_at='2023-11-29T14:53:35.985073',shelved_host='user',shelved_image_id='1899ee72-ac97-444d-b202-ee32877063c9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG os_vif [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5e51e0f-aa39-532d-87e8-db6657701644', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd308f9fc-29, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd308f9fc-29, col_values=(('qos', UUID('3efd1402-f9e8-4da1-9028-80313b894eb2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd308f9fc-29, col_values=(('external_ids', {'iface-id': 'd308f9fc-29b3-4820-8aea-0f43bd60c687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ae:d6', 'vm-uuid': '30087951-cb13-465c-8658-93fd8f413b5f'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:30 user nova-compute[75215]: INFO os_vif [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29')
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] No VIF found with MAC fa:16:3e:1c:ae:d6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:55:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance spawned successfully.
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:32 user nova-compute[75215]: WARNING nova.compute.manager [req-b2cf31ff-74a1-4123-b67a-6f705fac7f7e req-a6b874e1-a4c9-4445-89f5-494ffffdced7 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:32 user nova-compute[75215]: WARNING nova.compute.manager [req-2e6e15cc-8337-4883-8b5b-60c9c4f6b115 req-15a80703-26ba-4742-aaad-6cfd3e0fc92b service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75215) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-55f787d3-9ff7-4b77-a483-508d232a784c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:34 user nova-compute[75215]: WARNING nova.compute.manager [req-226b1237-301b-4511-8f96-653337c840f3 req-7d717e31-34c9-467f-9786-213c1c9c4c57 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:55:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance spawned successfully.
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e3178067-884e-483d-81ea-31d330af3d55 tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.673s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Starting finish_revert_migration {{(pid=75215) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start _get_guest_xml network_info=[{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6506f766-cbed-462b-8ada-6cdf8ee1bb8c', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a4d29026-19d4-4558-b8fe-a56b1bb81a1e', 'attached_at': '2023-11-29T14:55:35.000000', 'detached_at': '', 'volume_id': '6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'serial': '6ad3b9cd-e702-40d1-818f-9a7d0a032286'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:55:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:55:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:35 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f058da-e6dc-48c9-b9b7-0d4b83cbe18d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:55:35 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c2f96e-5cbf-40ab-9a7c-ec059a1dfd23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286] added
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[818dbf36-17fe-42bb-9f2d-fbf75dac663a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e0fb0-e974-43ea-a9de-dfd0772bfed1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APEYijve" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc8f811-aa1a-4d76-a4b0-3c21629c47fc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APEYijve'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01cb8ad-2f35-4f82-8630-1500c511be30]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539d336-8ba3-453e-aec7-16b72303d63c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f68b5bf-f8f2-4ee2-b155-e600a2f50a6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:55:35 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f988f3d3-ac07-4889-8fda-70950f94519b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ecdabb-db57-481a-8027-a9f171f4dd7f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:35 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6ca63-ab15-4923-be40-54a732ecccc0]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:55:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evaIlNig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:55:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839626261616561', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.471s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:55:36 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1156544-67d2-4788-8ce1-6dd26e133fe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:55:36 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:55:36 user nova-compute[75215]:   <uuid>a4d29026-19d4-4558-b8fe-a56b1bb81a1e</uuid>
Nov 29 14:55:36 user nova-compute[75215]:   <name>instance-00000014</name>
Nov 29 14:55:36 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:55:36 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:55:36 user nova-compute[75215]:   <metadata>
Nov 29 14:55:36 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:55:36 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherB-server-2011968674</nova:name>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:55:34</nova:creationTime>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:55:36 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:55:36 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:owner>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:user uuid="17839d64f1ee42528d08a7d00cd3159d">tempest-ServerActionsTestOtherB-291681319-project-member</nova:user>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:project uuid="2714f996f4404fd5a282aa4866064738">tempest-ServerActionsTestOtherB-291681319</nova:project>
Nov 29 14:55:36 user nova-compute[75215]:       </nova:owner>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:55:36 user nova-compute[75215]:       <nova:ports>
Nov 29 14:55:36 user nova-compute[75215]:         <nova:port uuid="9c699603-deba-4c85-a935-74136b77ed44">
Nov 29 14:55:36 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 14:55:36 user nova-compute[75215]:         </nova:port>
Nov 29 14:55:36 user nova-compute[75215]:       </nova:ports>
Nov 29 14:55:36 user nova-compute[75215]:     </nova:instance>
Nov 29 14:55:36 user nova-compute[75215]:   </metadata>
Nov 29 14:55:36 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:55:36 user nova-compute[75215]:     <system>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="serial">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="uuid">a4d29026-19d4-4558-b8fe-a56b1bb81a1e</entry>
Nov 29 14:55:36 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:55:36 user nova-compute[75215]:     </system>
Nov 29 14:55:36 user nova-compute[75215]:   </sysinfo>
Nov 29 14:55:36 user nova-compute[75215]:   <os>
Nov 29 14:55:36 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:55:36 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:55:36 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:55:36 user nova-compute[75215]:   </os>
Nov 29 14:55:36 user nova-compute[75215]:   <features>
Nov 29 14:55:36 user nova-compute[75215]:     <acpi/>
Nov 29 14:55:36 user nova-compute[75215]:     <apic/>
Nov 29 14:55:36 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:55:36 user nova-compute[75215]:   </features>
Nov 29 14:55:36 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:55:36 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:55:36 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:55:36 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:55:36 user nova-compute[75215]:   </clock>
Nov 29 14:55:36 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:55:36 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:55:36 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:55:36 user nova-compute[75215]:   </cpu>
Nov 29 14:55:36 user nova-compute[75215]:   <devices>
Nov 29 14:55:36 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:55:36 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:55:36 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk"/>
Nov 29 14:55:36 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:55:36 user nova-compute[75215]:     </disk>
Nov 29 14:55:36 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 14:55:36 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:36 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 14:55:36 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:55:36 user nova-compute[75215]:       <serial>6ad3b9cd-e702-40d1-818f-9a7d0a032286</serial>
Nov 29 14:55:36 user nova-compute[75215]:     </disk>
Nov 29 14:55:36 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:55:36 user nova-compute[75215]:       <mac address="fa:16:3e:c6:77:67"/>
Nov 29 14:55:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:36 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:55:36 user nova-compute[75215]:       <target dev="tap9c699603-de"/>
Nov 29 14:55:36 user nova-compute[75215]:     </interface>
Nov 29 14:55:36 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:55:36 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/console.log" append="off"/>
Nov 29 14:55:36 user nova-compute[75215]:     </serial>
Nov 29 14:55:36 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:55:36 user nova-compute[75215]:     <video>
Nov 29 14:55:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:36 user nova-compute[75215]:     </video>
Nov 29 14:55:36 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:55:36 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:55:36 user nova-compute[75215]:     </rng>
Nov 29 14:55:36 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:55:36 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:55:36 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:55:36 user nova-compute[75215]:     </memballoon>
Nov 29 14:55:36 user nova-compute[75215]:   </devices>
Nov 29 14:55:36 user nova-compute[75215]: </domain>
Nov 29 14:55:36 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f15b42b2-f30a-5f39-b9b1-2c58db7b35db', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb6aeba-0175-478b-9037-8c745ca6b16f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4] added
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c699603-de, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c699603-de, col_values=(('qos', UUID('1c2bddf8-2d60-4912-86e4-bd5b31b05e22')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c699603-de, col_values=(('external_ids', {'iface-id': '9c699603-deba-4c85-a935-74136b77ed44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:77:67', 'vm-uuid': 'a4d29026-19d4-4558-b8fe-a56b1bb81a1e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bdcfc-7d61-41e5-b627-d3aa948a1684]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:36 user nova-compute[75215]: INFO os_vif [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64021d20-b84c-4af7-ada6-94b92d06f9d1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evaIlNig {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evaIlNig" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[920fc64a-4bc8-4e6f-80cb-fb06f19f97d8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'evaIlNig'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1660c2-e9d0-4887-bacd-562762f0a187]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f1868b-7552-4a8b-aceb-8b3259744821]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e08fe-d1bd-4fc8-b512-3832cd4beffc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260]
Nov 29 14:55:36 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260] successful.
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9542aa-9064-4e75-bad4-65f5c9375c2c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865a1ac-e6a6-472c-b728-a662310fb3eb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)
Nov 29 14:55:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f6bb9-aa34-4df6-9054-78a1167b45a4]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:55:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evaIlNig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:55:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:55:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] <== connect_volume: return (1857ms) {'type': 'block', 'scsi_wwn': '23162663363343264', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162663363343264', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:55:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lazy-loading 'flavor' on Instance uuid 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:55:37 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:37 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:55:37 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:55:37 user nova-compute[75215]:   <serial>ec431a72-6829-492d-b2e7-c490599b61e4</serial>
Nov 29 14:55:37 user nova-compute[75215]: </disk>
Nov 29 14:55:37 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:38 user nova-compute[75215]: WARNING nova.compute.manager [req-3d722a42-6a7d-4e51-9edd-4e4d03922cdb req-8d06a2b0-57e5-4557-828f-a68eb17b4a9a service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state resized and task_state resize_reverting.
Nov 29 14:55:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] No VIF found with MAC fa:16:3e:e9:ff:a7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b8a05d0d-9a47-4aad-aae3-632713f0dbee tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.604s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:40 user nova-compute[75215]: WARNING nova.compute.manager [req-917a558e-aa2f-4640-a19f-320be808839a req-93a8fd49-96bf-42d7-9b06-efea7775a762 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state resized and task_state resize_reverting.
Nov 29 14:55:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:40 user nova-compute[75215]: INFO nova.compute.manager [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Detaching volume ec431a72-6829-492d-b2e7-c490599b61e4
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:55:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance running successfully.
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] finish_revert_migration finished successfully. {{(pid=75215) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 14:55:40 user nova-compute[75215]: INFO nova.virt.block_device [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Attempting to driver detach volume ec431a72-6829-492d-b2e7-c490599b61e4 from mountpoint /dev/vdb
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Attempting to detach device vdb from instance 793c33dc-7213-4c2f-b419-bf15a1713c6e from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:55:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:40 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:55:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:55:40 user nova-compute[75215]:   <serial>ec431a72-6829-492d-b2e7-c490599b61e4</serial>
Nov 29 14:55:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:55:40 user nova-compute[75215]: </disk>
Nov 29 14:55:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:55:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Successfully detached device vdb from instance 793c33dc-7213-4c2f-b419-bf15a1713c6e from the persistent domain config.
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 793c33dc-7213-4c2f-b419-bf15a1713c6e from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:55:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:55:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:55:40 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:55:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:55:40 user nova-compute[75215]:   <serial>ec431a72-6829-492d-b2e7-c490599b61e4</serial>
Nov 29 14:55:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:55:40 user nova-compute[75215]: </disk>
Nov 29 14:55:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:55:40 user nova-compute[75215]: INFO nova.compute.manager [None req-e66b5532-fee8-4a56-8317-1217a7f3245a tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance to original state: 'active'
Nov 29 14:55:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:55:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:55:55 user nova-compute[75215]: INFO nova.compute.claims [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Claim successful on node user
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:55:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.policy [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b4b269cff8f482cbbd277204b42585b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e2fbd35cd4dc89ed674708af95612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:55:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Creating image(s)
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk 1073741824" returned: 0 in 0.069s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Successfully created port: 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Cannot resize image /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Ensure instance console log exists: /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Successfully updated port: 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing instance network info cache due to event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance network_info: |[{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start _get_guest_xml network_info=[{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:55:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717667989',display_name='tempest-ServerRescueNegativeTestJSON-server-717667989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-717667989',id=29,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELoWMOCpUjfVjdT3005LPYUzA+zNZ76VnwUzay/FWAhq1czPWHUfyoD4EDyLkdPFx7SBdFImuVyNTSpI617Ea7wdifORSar4tRDlUh4tYavPoBKHI9oArt84kwg2Eix0Q==',key_name='tempest-keypair-848980801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-7ya4mxl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b4b269cff8f482cbbd277204b42585b',uuid=9ced07bb-dd04-4b80-98ee-64afe84ea0ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:55:57 user nova-compute[75215]:   <uuid>9ced07bb-dd04-4b80-98ee-64afe84ea0ab</uuid>
Nov 29 14:55:57 user nova-compute[75215]:   <name>instance-0000001d</name>
Nov 29 14:55:57 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:55:57 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:55:57 user nova-compute[75215]:   <metadata>
Nov 29 14:55:57 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:55:57 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-717667989</nova:name>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:55:57</nova:creationTime>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:55:57 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:55:57 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:owner>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:55:57 user nova-compute[75215]:       </nova:owner>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:55:57 user nova-compute[75215]:       <nova:ports>
Nov 29 14:55:57 user nova-compute[75215]:         <nova:port uuid="98c955ff-b257-4fd5-98d0-c75d3b63287f">
Nov 29 14:55:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 14:55:57 user nova-compute[75215]:         </nova:port>
Nov 29 14:55:57 user nova-compute[75215]:       </nova:ports>
Nov 29 14:55:57 user nova-compute[75215]:     </nova:instance>
Nov 29 14:55:57 user nova-compute[75215]:   </metadata>
Nov 29 14:55:57 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:55:57 user nova-compute[75215]:     <system>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="serial">9ced07bb-dd04-4b80-98ee-64afe84ea0ab</entry>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="uuid">9ced07bb-dd04-4b80-98ee-64afe84ea0ab</entry>
Nov 29 14:55:57 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:55:57 user nova-compute[75215]:     </system>
Nov 29 14:55:57 user nova-compute[75215]:   </sysinfo>
Nov 29 14:55:57 user nova-compute[75215]:   <os>
Nov 29 14:55:57 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:55:57 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:55:57 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:55:57 user nova-compute[75215]:   </os>
Nov 29 14:55:57 user nova-compute[75215]:   <features>
Nov 29 14:55:57 user nova-compute[75215]:     <acpi/>
Nov 29 14:55:57 user nova-compute[75215]:     <apic/>
Nov 29 14:55:57 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:55:57 user nova-compute[75215]:   </features>
Nov 29 14:55:57 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:55:57 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:55:57 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:55:57 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:55:57 user nova-compute[75215]:   </clock>
Nov 29 14:55:57 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:55:57 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:55:57 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:55:57 user nova-compute[75215]:   </cpu>
Nov 29 14:55:57 user nova-compute[75215]:   <devices>
Nov 29 14:55:57 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:55:57 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:55:57 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk"/>
Nov 29 14:55:57 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:55:57 user nova-compute[75215]:     </disk>
Nov 29 14:55:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:55:57 user nova-compute[75215]:       <mac address="fa:16:3e:1e:be:38"/>
Nov 29 14:55:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:55:57 user nova-compute[75215]:       <target dev="tap98c955ff-b2"/>
Nov 29 14:55:57 user nova-compute[75215]:     </interface>
Nov 29 14:55:57 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:55:57 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/console.log" append="off"/>
Nov 29 14:55:57 user nova-compute[75215]:     </serial>
Nov 29 14:55:57 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:55:57 user nova-compute[75215]:     <video>
Nov 29 14:55:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:55:57 user nova-compute[75215]:     </video>
Nov 29 14:55:57 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:55:57 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:55:57 user nova-compute[75215]:     </rng>
Nov 29 14:55:57 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:55:57 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:55:57 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:55:57 user nova-compute[75215]:     </memballoon>
Nov 29 14:55:57 user nova-compute[75215]:   </devices>
Nov 29 14:55:57 user nova-compute[75215]: </domain>
Nov 29 14:55:57 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717667989',display_name='tempest-ServerRescueNegativeTestJSON-server-717667989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-717667989',id=29,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELoWMOCpUjfVjdT3005LPYUzA+zNZ76VnwUzay/FWAhq1czPWHUfyoD4EDyLkdPFx7SBdFImuVyNTSpI617Ea7wdifORSar4tRDlUh4tYavPoBKHI9oArt84kwg2Eix0Q==',key_name='tempest-keypair-848980801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-7ya4mxl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b4b269cff8f482cbbd277204b42585b',uuid=9ced07bb-dd04-4b80-98ee-64afe84ea0ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG os_vif [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f858472-73db-508e-8f27-c2ef66a873f0', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98c955ff-b2, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98c955ff-b2, col_values=(('qos', UUID('062d4787-d6a2-46d8-95af-b4f7ba9056c5')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98c955ff-b2, col_values=(('external_ids', {'iface-id': '98c955ff-b257-4fd5-98d0-c75d3b63287f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:be:38', 'vm-uuid': '9ced07bb-dd04-4b80-98ee-64afe84ea0ab'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:57 user nova-compute[75215]: INFO os_vif [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2')
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:1e:be:38, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updated VIF entry in instance network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8481eafe-d19d-4889-afcc-85a26f98bbf3 req-b7174e16-ed7a-40f2-b9ce-8e53cbc5cc4f service nova] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:55:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:55:59 user nova-compute[75215]: WARNING nova.compute.manager [req-7b596012-fafe-4e93-9ea2-550c26de523f req-9502110e-2a06-4208-a354-b5a5af161a1a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state building and task_state spawning.
Nov 29 14:55:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 793c33dc-7213-4c2f-b419-bf15a1713c6e is timed out.
Nov 29 14:56:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Successfully detached device vdb from instance 793c33dc-7213-4c2f-b419-bf15a1713c6e from the live domain config.
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evaIlNig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:56:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:56:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance spawned successfully.
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba09a24-4445-42f6-941c-b07929556faa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:56:01 user nova-compute[75215]: No targets found.
Nov 29 14:56:01 user nova-compute[75215]: iSNS:
Nov 29 14:56:01 user nova-compute[75215]: No targets found.
Nov 29 14:56:01 user nova-compute[75215]: STATIC:
Nov 29 14:56:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:56:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:56:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:56:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4
Nov 29 14:56:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:56:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:56:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:56:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:56:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:56:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:56:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:56:01 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:56:01 user nova-compute[75215]: FIRMWARE:
Nov 29 14:56:01 user nova-compute[75215]: No targets found.
Nov 29 14:56:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:56:01 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:56:01 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c428e-7693-4cc7-b2c2-ca2d977a48da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a8c79-8d21-41ee-8781-420e3e576fe0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)
Nov 29 14:56:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:56:01 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 (non-flash)
Nov 29 14:56:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c8835eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28783e6d-828b-4938-9033-cfc1ff13024f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5fe4d-7c00-4f64-80ae-09a20e058e3d]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:56:01 user nova-compute[75215]: INFO nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:01 user nova-compute[75215]: WARNING nova.compute.manager [req-f271358e-51e0-4b96-97ac-c7b9b2376b11 req-49ea73b0-fd96-40d0-8e05-724c88704a4a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state building and task_state spawning.
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac7d25-6cce-4227-a4b9-83dd35301fcb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36db864-630c-4ca3-a1f2-2cd60e8033ff]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5d4d41-f8ec-4f8f-89a3-1b548f540d1c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: INFO nova.compute.manager [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Took 6.33 seconds to build instance.
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0713fc2-01f7-4afc-90d0-7c8e6b362a3e tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d47ad3-1191-49cd-b6c3-e72e400659b2]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260]
Nov 29 14:56:01 user nova-compute[75215]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4, portal: 172.16.0.220,3260] successful.
Nov 29 14:56:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec431a72-6829-492d-b2e7-c490599b61e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83431b17-c109-46b0-aca7-78af5eca93ed]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] <== disconnect_volume: return (338ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:56:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lazy-loading 'flavor' on Instance uuid 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7d9be993-7bf8-4f0e-9613-21f9306541f4 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:03 user nova-compute[75215]: INFO nova.compute.manager [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Terminating instance
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-unplugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] No waiting events found dispatching network-vif-unplugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-770d4c6f-fb32-4872-8816-a951b39e719b req-26789024-e0d5-4cbe-b6b5-335355893473 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-unplugged-e37ab787-263e-4d93-9590-96f7fa076741 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Instance destroyed successfully.
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lazy-loading 'resources' on Instance uuid c9538833-b02d-4cf7-ad9e-b2b34eb77521 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235848862',display_name='tempest-VolumesActionsTest-instance-235848862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235848862',id=27,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:54:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-sxpl394v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:54:19Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=c9538833-b02d-4cf7-ad9e-b2b34eb77521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "e37ab787-263e-4d93-9590-96f7fa076741", "address": "fa:16:3e:b0:b2:5e", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape37ab787-26", "ovs_interfaceid": "e37ab787-263e-4d93-9590-96f7fa076741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG os_vif [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape37ab787-26, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abaa22a6-3f60-41a9-afae-e4105c7125cd) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:04 user nova-compute[75215]: INFO os_vif [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b2:5e,bridge_name='br-int',has_traffic_filtering=True,id=e37ab787-263e-4d93-9590-96f7fa076741,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape37ab787-26')
Nov 29 14:56:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Deleting instance files /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521_del
Nov 29 14:56:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Deletion of /opt/stack/data/nova/instances/c9538833-b02d-4cf7-ad9e-b2b34eb77521_del complete
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:04 user nova-compute[75215]: INFO nova.compute.manager [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-57953a8d-92d6-4736-a6f0-dd0bee20e835 req-736c143f-d6dc-4b3a-96cf-2a53f31de899 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-deleted-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:04 user nova-compute[75215]: INFO nova.compute.manager [req-57953a8d-92d6-4736-a6f0-dd0bee20e835 req-736c143f-d6dc-4b3a-96cf-2a53f31de899 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Neutron deleted interface e37ab787-263e-4d93-9590-96f7fa076741; detaching it from the instance and deleting it from the info cache
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-57953a8d-92d6-4736-a6f0-dd0bee20e835 req-736c143f-d6dc-4b3a-96cf-2a53f31de899 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:04 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Took 0.56 seconds to deallocate network for instance.
Nov 29 14:56:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-57953a8d-92d6-4736-a6f0-dd0bee20e835 req-736c143f-d6dc-4b3a-96cf-2a53f31de899 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Detach interface failed, port_id=e37ab787-263e-4d93-9590-96f7fa076741, reason: Instance c9538833-b02d-4cf7-ad9e-b2b34eb77521 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:05 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Deleted allocations for instance c9538833-b02d-4cf7-ad9e-b2b34eb77521
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a2d56653-7ae2-4ae4-8d79-ac7519f0d165 tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] Acquiring lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] Lock "c9538833-b02d-4cf7-ad9e-b2b34eb77521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] No waiting events found dispatching network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:05 user nova-compute[75215]: WARNING nova.compute.manager [req-9bba6cfc-8f92-45ce-a3d5-b4adf5935b7a req-575371a1-d372-4d87-83ec-909b880bc4f8 service nova] [instance: c9538833-b02d-4cf7-ad9e-b2b34eb77521] Received unexpected event network-vif-plugged-e37ab787-263e-4d93-9590-96f7fa076741 for instance with vm_state deleted and task_state None.
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:06 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'c9538833-b02d-4cf7-ad9e-b2b34eb77521' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c9538833-b02d-4cf7-ad9e-b2b34eb77521' (instance-0000001b)
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:56:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=24.73000717163086GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 27e9c891-3fb0-424a-b6b1-22a123c18271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 793c33dc-7213-4c2f-b419-bf15a1713c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 30087951-cb13-465c-8658-93fd8f413b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:56:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:23 user nova-compute[75215]: INFO nova.compute.manager [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Unrescuing
Nov 29 14:56:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:56:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:56:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'flavor' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:24 user nova-compute[75215]: WARNING nova.compute.manager [req-b7b2cfa5-6303-41e5-b638-abd38ccbd8bf req-8864658a-6068-428d-af1c-b80884f396db service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance destroyed successfully.
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:26 user nova-compute[75215]: WARNING nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:26 user nova-compute[75215]: WARNING nova.compute.manager [req-627f1e91-545c-408a-b0fd-737566457d21 req-d34f31c8-246b-43ad-9dee-3740026749f2 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2807e01b-8a28-45ff-a2c7-fcfbb681f948 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:28 user nova-compute[75215]: WARNING nova.compute.manager [req-3cf89590-a404-4f62-9656-e36479c31f2e req-b2445619-8506-4671-a8ee-90369ee5ec70 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state active and task_state None.
Nov 29 14:56:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:35 user nova-compute[75215]: INFO nova.compute.manager [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Terminating instance
Nov 29 14:56:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-unplugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] No waiting events found dispatching network-vif-unplugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-b262d758-5eda-4b25-9c41-8b4731cd20e1 req-758f32d6-ee41-49f0-b17b-8b4ba590ba36 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-unplugged-1f565d20-bdd4-4c59-919d-1455a7e8900c for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:56:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Instance destroyed successfully.
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lazy-loading 'resources' on Instance uuid 793c33dc-7213-4c2f-b419-bf15a1713c6e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-287711067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2877110',id=26,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPlOIozfyLDA5Yyet+/F1GtNZgMDX6cIEK2juGbE2W7Yj5zgDql2Z7Yj8VPLBdfoIK2ZxafOBBbLJibSq7a2GTRxnvhBLegkgzsmYajFhGe0HQv2bQlNTnFwnqhWOziw==',key_name='tempest-keypair-545117171',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3471da48257942a4a3882778b30ae9ba',ramdisk_id='',reservation_id='r-caj249bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54f0adb60951476ab67ad77e8b1dba1d',uuid=793c33dc-7213-4c2f-b419-bf15a1713c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converting VIF {"id": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "address": "fa:16:3e:e9:ff:a7", "network": {"id": "3b8b6845-786e-489e-9cfc-0c79ed5f9a96", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995233992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3471da48257942a4a3882778b30ae9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f565d20-bd", "ovs_interfaceid": "1f565d20-bdd4-4c59-919d-1455a7e8900c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG os_vif [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f565d20-bd, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2c1a5b7-0347-4046-81d5-8ea807767222) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:36 user nova-compute[75215]: INFO os_vif [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ff:a7,bridge_name='br-int',has_traffic_filtering=True,id=1f565d20-bdd4-4c59-919d-1455a7e8900c,network=Network(3b8b6845-786e-489e-9cfc-0c79ed5f9a96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f565d20-bd')
Nov 29 14:56:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Deleting instance files /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e_del
Nov 29 14:56:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Deletion of /opt/stack/data/nova/instances/793c33dc-7213-4c2f-b419-bf15a1713c6e_del complete
Nov 29 14:56:36 user nova-compute[75215]: INFO nova.compute.manager [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 29 14:56:36 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:56:36 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:37 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Took 0.90 seconds to deallocate network for instance.
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3ff324b-85ca-4415-96c9-0afcf371c3f6 req-cf2bccf0-a769-41a2-818a-c8d5607c0414 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-deleted-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:37 user nova-compute[75215]: INFO nova.compute.manager [req-c3ff324b-85ca-4415-96c9-0afcf371c3f6 req-cf2bccf0-a769-41a2-818a-c8d5607c0414 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Neutron deleted interface 1f565d20-bdd4-4c59-919d-1455a7e8900c; detaching it from the instance and deleting it from the info cache
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-c3ff324b-85ca-4415-96c9-0afcf371c3f6 req-cf2bccf0-a769-41a2-818a-c8d5607c0414 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3ff324b-85ca-4415-96c9-0afcf371c3f6 req-cf2bccf0-a769-41a2-818a-c8d5607c0414 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Detach interface failed, port_id=1f565d20-bdd4-4c59-919d-1455a7e8900c, reason: Instance 793c33dc-7213-4c2f-b419-bf15a1713c6e could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:56:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:37 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Deleted allocations for instance 793c33dc-7213-4c2f-b419-bf15a1713c6e
Nov 29 14:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-570a987e-cc4b-4f5f-9f81-695164231582 tempest-TestServerVolumeAttachScenarioOldVersion-659879777 tempest-TestServerVolumeAttachScenarioOldVersion-659879777-project-member] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] Acquiring lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] Lock "793c33dc-7213-4c2f-b419-bf15a1713c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] No waiting events found dispatching network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:56:38 user nova-compute[75215]: WARNING nova.compute.manager [req-8a87d6ba-8544-448f-baa0-b7666d5e01b8 req-6f63de45-8096-49ab-adf1-35561afb1ec0 service nova] [instance: 793c33dc-7213-4c2f-b419-bf15a1713c6e] Received unexpected event network-vif-plugged-1f565d20-bdd4-4c59-919d-1455a7e8900c for instance with vm_state deleted and task_state None.
Nov 29 14:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:54 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:56:54 user nova-compute[75215]: INFO nova.compute.claims [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Claim successful on node user
Nov 29 14:56:54 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:56:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.policy [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49aba78eccc74f9fa31f33a8199d3aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6bb0db9ad84e11b601e33faec86430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:56:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Creating image(s)
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "/opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "/opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "/opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk 1073741824" returned: 0 in 0.049s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:56:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Cannot resize image /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Ensure instance console log exists: /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:56:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Successfully created port: b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-changed-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Refreshing instance network info cache due to event network-changed-2c36b828-a881-4bde-8076-9eec4e3eec2b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] Acquiring lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] Acquired lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Refreshing network info cache for port 2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updated VIF entry in instance network info cache for port 2c36b828-a881-4bde-8076-9eec4e3eec2b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updating instance_info_cache with network_info: [{"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3462fd7-9692-4e22-a36d-b78c99b3f7fa req-43d282d5-dfba-47a8-aa9d-57209f745a73 service nova] Releasing lock "refresh_cache-b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Successfully updated port: b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquired lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Updating instance_info_cache with network_info: [{"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Releasing lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Instance network_info: |[{"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Start _get_guest_xml network_info=[{"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:56:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:56:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1628489158',display_name='tempest-VolumesActionsTest-instance-1628489158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1628489158',id=30,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-wrnn66q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:56:55Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=6875f564-d0c8-4ddc-8e15-0d5aa52ef31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lazy-loading 'pci_devices' on Instance uuid 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:56:58 user nova-compute[75215]:   <uuid>6875f564-d0c8-4ddc-8e15-0d5aa52ef31b</uuid>
Nov 29 14:56:58 user nova-compute[75215]:   <name>instance-0000001e</name>
Nov 29 14:56:58 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:56:58 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:56:58 user nova-compute[75215]:   <metadata>
Nov 29 14:56:58 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:56:58 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-1628489158</nova:name>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:56:58</nova:creationTime>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:56:58 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:56:58 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:owner>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:user uuid="49aba78eccc74f9fa31f33a8199d3aff">tempest-VolumesActionsTest-1497530955-project-member</nova:user>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:project uuid="ce6bb0db9ad84e11b601e33faec86430">tempest-VolumesActionsTest-1497530955</nova:project>
Nov 29 14:56:58 user nova-compute[75215]:       </nova:owner>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:56:58 user nova-compute[75215]:       <nova:ports>
Nov 29 14:56:58 user nova-compute[75215]:         <nova:port uuid="b4c4255a-012d-4cca-a1ef-9287f1b4604a">
Nov 29 14:56:58 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 14:56:58 user nova-compute[75215]:         </nova:port>
Nov 29 14:56:58 user nova-compute[75215]:       </nova:ports>
Nov 29 14:56:58 user nova-compute[75215]:     </nova:instance>
Nov 29 14:56:58 user nova-compute[75215]:   </metadata>
Nov 29 14:56:58 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:56:58 user nova-compute[75215]:     <system>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="serial">6875f564-d0c8-4ddc-8e15-0d5aa52ef31b</entry>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="uuid">6875f564-d0c8-4ddc-8e15-0d5aa52ef31b</entry>
Nov 29 14:56:58 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:56:58 user nova-compute[75215]:     </system>
Nov 29 14:56:58 user nova-compute[75215]:   </sysinfo>
Nov 29 14:56:58 user nova-compute[75215]:   <os>
Nov 29 14:56:58 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:56:58 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:56:58 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:56:58 user nova-compute[75215]:   </os>
Nov 29 14:56:58 user nova-compute[75215]:   <features>
Nov 29 14:56:58 user nova-compute[75215]:     <acpi/>
Nov 29 14:56:58 user nova-compute[75215]:     <apic/>
Nov 29 14:56:58 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:56:58 user nova-compute[75215]:   </features>
Nov 29 14:56:58 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:56:58 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:56:58 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:56:58 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:56:58 user nova-compute[75215]:   </clock>
Nov 29 14:56:58 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:56:58 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:56:58 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:56:58 user nova-compute[75215]:   </cpu>
Nov 29 14:56:58 user nova-compute[75215]:   <devices>
Nov 29 14:56:58 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:56:58 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:56:58 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk"/>
Nov 29 14:56:58 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:56:58 user nova-compute[75215]:     </disk>
Nov 29 14:56:58 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:56:58 user nova-compute[75215]:       <mac address="fa:16:3e:1a:29:b7"/>
Nov 29 14:56:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:56:58 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:56:58 user nova-compute[75215]:       <target dev="tapb4c4255a-01"/>
Nov 29 14:56:58 user nova-compute[75215]:     </interface>
Nov 29 14:56:58 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:56:58 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/console.log" append="off"/>
Nov 29 14:56:58 user nova-compute[75215]:     </serial>
Nov 29 14:56:58 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:56:58 user nova-compute[75215]:     <video>
Nov 29 14:56:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:56:58 user nova-compute[75215]:     </video>
Nov 29 14:56:58 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:56:58 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:56:58 user nova-compute[75215]:     </rng>
Nov 29 14:56:58 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:56:58 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:56:58 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:56:58 user nova-compute[75215]:     </memballoon>
Nov 29 14:56:58 user nova-compute[75215]:   </devices>
Nov 29 14:56:58 user nova-compute[75215]: </domain>
Nov 29 14:56:58 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1628489158',display_name='tempest-VolumesActionsTest-instance-1628489158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1628489158',id=30,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-wrnn66q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:56:55Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=6875f564-d0c8-4ddc-8e15-0d5aa52ef31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG os_vif [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a22e2d0-76b4-550b-bd72-1cc67c8fe831', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4c4255a-01, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4c4255a-01, col_values=(('qos', UUID('fcadbe1b-4b86-47e7-9862-fe3bd2c2db8f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4c4255a-01, col_values=(('external_ids', {'iface-id': 'b4c4255a-012d-4cca-a1ef-9287f1b4604a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:29:b7', 'vm-uuid': '6875f564-d0c8-4ddc-8e15-0d5aa52ef31b'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: INFO os_vif [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01')
Nov 29 14:56:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] No VIF found with MAC fa:16:3e:1a:29:b7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:56:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [{"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-a4d29026-19d4-4558-b8fe-a56b1bb81a1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-changed-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Refreshing instance network info cache due to event network-changed-b4c4255a-012d-4cca-a1ef-9287f1b4604a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] Acquiring lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] Acquired lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Refreshing network info cache for port b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Updated VIF entry in instance network info cache for port b4c4255a-012d-4cca-a1ef-9287f1b4604a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Updating instance_info_cache with network_info: [{"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6222f57b-081d-42fc-8e9f-bcbc42c2ba0f req-f59404c6-bc8a-4004-854e-c6f6e4047d3e service nova] Releasing lock "refresh_cache-6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:56:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] No waiting events found dispatching network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:00 user nova-compute[75215]: WARNING nova.compute.manager [req-8a7c9870-f17d-4bf9-8236-efc3794f8f1c req-55bccadd-25eb-4bad-b6f7-5ab9251826dc service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received unexpected event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a for instance with vm_state building and task_state spawning.
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:00 user nova-compute[75215]: INFO nova.compute.manager [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Attaching volume 2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 to /dev/vdb
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.utils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1027b2b8-f929-4dd0-94a0-4f91fc20a47a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f0358-a125-48e0-aa98-f2994f2c861a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[767a5e28-9dbd-4bb5-b8c3-eead1386c630]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23993d8-df8a-405f-befe-d1ae87db9feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:57:00 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:57:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce729278-f68b-4eaa-b435-817b4e19b44c]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG os_brick.utils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updating existing volume attachment record: 3f686961-cfd8-407a-b8c3-a48946f76429 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:57:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Instance spawned successfully.
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:57:02 user nova-compute[75215]: INFO nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] No waiting events found dispatching network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:02 user nova-compute[75215]: WARNING nova.compute.manager [req-b8db6d47-6adf-4a3d-a950-e0b5547b61e4 req-e1c08c9f-d94f-488e-bf11-191cbe1eef27 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received unexpected event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a for instance with vm_state building and task_state spawning.
Nov 29 14:57:02 user nova-compute[75215]: INFO nova.compute.manager [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Took 7.65 seconds to build instance.
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec308b52-7f78-49e4-8078-8497fe58201b tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.746s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:57:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:57:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquired lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'info_cache' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Releasing lock "refresh_cache-25d981de-63c5-4012-8f38-fca174d1f3f7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:57:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance destroyed successfully.
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'resources' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG os_vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e908e58-ac, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d7fcf21-c1e8-43b5-b425-e5abec0962bd) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:04 user nova-compute[75215]: INFO os_vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start _get_guest_xml network_info=[{"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:57:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'numa_topology' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:57:05 user nova-compute[75215]:   <uuid>25d981de-63c5-4012-8f38-fca174d1f3f7</uuid>
Nov 29 14:57:05 user nova-compute[75215]:   <name>instance-00000012</name>
Nov 29 14:57:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:57:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:57:05 user nova-compute[75215]:   <metadata>
Nov 29 14:57:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:57:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-612258283</nova:name>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:57:05</nova:creationTime>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:57:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:57:05 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:owner>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:user uuid="bfc31705a39b4447a3ad96ca8d073144">tempest-AttachVolumeTestJSON-1589123637-project-member</nova:user>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:project uuid="7f0dc3e9a4bc447a80d5983bbafe3059">tempest-AttachVolumeTestJSON-1589123637</nova:project>
Nov 29 14:57:05 user nova-compute[75215]:       </nova:owner>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:57:05 user nova-compute[75215]:       <nova:ports>
Nov 29 14:57:05 user nova-compute[75215]:         <nova:port uuid="2e908e58-ac66-489e-b05c-69fcccc1f750">
Nov 29 14:57:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 14:57:05 user nova-compute[75215]:         </nova:port>
Nov 29 14:57:05 user nova-compute[75215]:       </nova:ports>
Nov 29 14:57:05 user nova-compute[75215]:     </nova:instance>
Nov 29 14:57:05 user nova-compute[75215]:   </metadata>
Nov 29 14:57:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:57:05 user nova-compute[75215]:     <system>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="serial">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="uuid">25d981de-63c5-4012-8f38-fca174d1f3f7</entry>
Nov 29 14:57:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:57:05 user nova-compute[75215]:     </system>
Nov 29 14:57:05 user nova-compute[75215]:   </sysinfo>
Nov 29 14:57:05 user nova-compute[75215]:   <os>
Nov 29 14:57:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:57:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:57:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:57:05 user nova-compute[75215]:   </os>
Nov 29 14:57:05 user nova-compute[75215]:   <features>
Nov 29 14:57:05 user nova-compute[75215]:     <acpi/>
Nov 29 14:57:05 user nova-compute[75215]:     <apic/>
Nov 29 14:57:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:57:05 user nova-compute[75215]:   </features>
Nov 29 14:57:05 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:57:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:57:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:57:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:57:05 user nova-compute[75215]:   </clock>
Nov 29 14:57:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:57:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:57:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:57:05 user nova-compute[75215]:   </cpu>
Nov 29 14:57:05 user nova-compute[75215]:   <devices>
Nov 29 14:57:05 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:57:05 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:57:05 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk"/>
Nov 29 14:57:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:57:05 user nova-compute[75215]:     </disk>
Nov 29 14:57:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:57:05 user nova-compute[75215]:       <mac address="fa:16:3e:85:ed:19"/>
Nov 29 14:57:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:57:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:57:05 user nova-compute[75215]:       <target dev="tap2e908e58-ac"/>
Nov 29 14:57:05 user nova-compute[75215]:     </interface>
Nov 29 14:57:05 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:57:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/console.log" append="off"/>
Nov 29 14:57:05 user nova-compute[75215]:     </serial>
Nov 29 14:57:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:57:05 user nova-compute[75215]:     <video>
Nov 29 14:57:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:57:05 user nova-compute[75215]:     </video>
Nov 29 14:57:05 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:57:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:57:05 user nova-compute[75215]:     </rng>
Nov 29 14:57:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:57:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:57:05 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:57:05 user nova-compute[75215]:     </memballoon>
Nov 29 14:57:05 user nova-compute[75215]:   </devices>
Nov 29 14:57:05 user nova-compute[75215]: </domain>
Nov 29 14:57:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Cannot resize image /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'migration_context' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Object Instance<25d981de-63c5-4012-8f38-fca174d1f3f7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG os_vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0811feb-cd2f-50e5-8ce8-00b549892c24', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e908e58-ac, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e908e58-ac, col_values=(('qos', UUID('c7f8eb6f-fdb7-4653-acb2-a252c7a94a1f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e908e58-ac, col_values=(('external_ids', {'iface-id': '2e908e58-ac66-489e-b05c-69fcccc1f750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:ed:19', 'vm-uuid': '25d981de-63c5-4012-8f38-fca174d1f3f7'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:05 user nova-compute[75215]: INFO os_vif [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:10 user nova-compute[75215]: WARNING nova.compute.manager [req-13eefb6b-5593-4802-a3b6-1a46bb24c679 req-c25588dc-1bdc-469c-951e-d17b70ecba97 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state powering-on.
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:10 user nova-compute[75215]: WARNING nova.compute.manager [req-a8355e45-2f45-45bc-bfaa-43c9443bb94f req-027af8fa-1553-4957-bbe4-655b723e0998 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state stopped and task_state powering-on.
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMmpwJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:57:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:57:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:57:10 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance rebooted successfully.
Nov 29 14:57:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=24.756263732910156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ec8ae81a-7f7e-47a4-a485-edf23d0be0cf tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d3bbee-c0d5-4547-91b2-be072708a645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:57:10 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374c169-7e3b-4b31-b55e-4f1ce0df19ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597] added
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d814b8-d8c5-4531-b6c7-dd7bb6c2551d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160c8b8-174e-43aa-b73f-d7bb9dffebf7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMmpwJVr {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMmpwJVr" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82f909a-0b09-4c16-92a5-b2607eca7b3c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMmpwJVr'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 27e9c891-3fb0-424a-b6b1-22a123c18271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 30087951-cb13-465c-8658-93fd8f413b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f7c264-9357-41cb-a546-63e6cf848116]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a07f4c-dca3-4851-8ef1-888121651757]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11282433-e95c-4b2f-8571-def4ac26f96d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260]
Nov 29 14:57:10 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260] successful.
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f521da-f344-4f3d-8db0-6531f3bcf53a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c7a50-8c84-4768-bab4-1032d358d2e5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)
Nov 29 14:57:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[085a4213-5b90-439f-aff2-35cc20a61f53]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMmpwJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26162376134663564', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162376134663564', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:57:11 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:57:11 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:57:11 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:57:11 user nova-compute[75215]:   <serial>2ccf8b8d-9aea-4c97-a354-0fa0ffb98597</serial>
Nov 29 14:57:11 user nova-compute[75215]: </disk>
Nov 29 14:57:11 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:99:00:e6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:57:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f74fe964-6a13-4db8-b8e2-eb8e891f0f20 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.960s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.compute.manager [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Terminating instance
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f0c9e7f0-0f2f-4531-855e-95423fef2b49 req-462609e1-ed53-46b6-bbc8-c9565c3ae008 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-unplugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.compute.manager [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Detaching volume 2ccf8b8d-9aea-4c97-a354-0fa0ffb98597
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.virt.block_device [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Attempting to driver detach volume 2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 from mountpoint /dev/vdb
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Attempting to detach device vdb from instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:57:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:57:13 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:57:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:57:13 user nova-compute[75215]:   <serial>2ccf8b8d-9aea-4c97-a354-0fa0ffb98597</serial>
Nov 29 14:57:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:57:13 user nova-compute[75215]: </disk>
Nov 29 14:57:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 from the persistent domain config.
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:57:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:57:13 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:57:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:57:13 user nova-compute[75215]:   <serial>2ccf8b8d-9aea-4c97-a354-0fa0ffb98597</serial>
Nov 29 14:57:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:57:13 user nova-compute[75215]: </disk>
Nov 29 14:57:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Instance destroyed successfully.
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lazy-loading 'resources' on Instance uuid 30087951-cb13-465c-8658-93fd8f413b5f {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1506387384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1506387384',id=23,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfwG4b4uJiI1Qp7Xu2eqaKSPf20u0Bc1yueaialTyylMIYUIT4wQHxg3y4ubwKAALxf6HX+RyE5C4hNXygmwBIxMXPqYjnKMwLwAmRIwlaf1q2AN2Ij1fMUMKjmwhzFSQ==',key_name='tempest-keypair-1964351599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce0446252d5486794553a9cae9281af',ramdisk_id='',reservation_id='r-uf4rxca6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1453470125',owner_user_name='tempest-AttachVolumeShelveTestJSON-1453470125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f3cbb55df1494f94e304bfc82c4c5c',uuid=30087951-cb13-465c-8658-93fd8f413b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converting VIF {"id": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "address": "fa:16:3e:1c:ae:d6", "network": {"id": "ab801e2e-5ddb-46b2-96ab-8b675a280e3d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-547934843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bce0446252d5486794553a9cae9281af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd308f9fc-29", "ovs_interfaceid": "d308f9fc-29b3-4820-8aea-0f43bd60c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG os_vif [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd308f9fc-29, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3efd1402-f9e8-4da1-9028-80313b894eb2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:13 user nova-compute[75215]: INFO os_vif [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=d308f9fc-29b3-4820-8aea-0f43bd60c687,network=Network(ab801e2e-5ddb-46b2-96ab-8b675a280e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd308f9fc-29')
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Deleting instance files /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f_del
Nov 29 14:57:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Deletion of /opt/stack/data/nova/instances/30087951-cb13-465c-8658-93fd8f413b5f_del complete
Nov 29 14:57:14 user nova-compute[75215]: INFO nova.compute.manager [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 29 14:57:14 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:57:14 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Took 0.87 seconds to deallocate network for instance.
Nov 29 14:57:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-c1a6c99b-04e7-4032-b275-18c0b431396b req-0ddf6654-af69-474e-8fc4-b76e15d29611 service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-deleted-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:15 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Deleted allocations for instance 30087951-cb13-465c-8658-93fd8f413b5f
Nov 29 14:57:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42b83ecb-42c0-4eca-9149-3d03c709885f tempest-AttachVolumeShelveTestJSON-1453470125 tempest-AttachVolumeShelveTestJSON-1453470125-project-member] Lock "30087951-cb13-465c-8658-93fd8f413b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] Acquiring lock "30087951-cb13-465c-8658-93fd8f413b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] Lock "30087951-cb13-465c-8658-93fd8f413b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] No waiting events found dispatching network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:15 user nova-compute[75215]: WARNING nova.compute.manager [req-0c43508e-96b1-466e-be5f-8a3809958d12 req-b2d18bbf-c91c-4f09-be1c-e447271a4dce service nova] [instance: 30087951-cb13-465c-8658-93fd8f413b5f] Received unexpected event network-vif-plugged-d308f9fc-29b3-4820-8aea-0f43bd60c687 for instance with vm_state deleted and task_state None.
Nov 29 14:57:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 is timed out.
Nov 29 14:57:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 from the live domain config.
Nov 29 14:57:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMmpwJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:57:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80531c6-7782-41c2-9441-c1e9804fc1f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:57:34 user nova-compute[75215]: No targets found.
Nov 29 14:57:34 user nova-compute[75215]: iSNS:
Nov 29 14:57:34 user nova-compute[75215]: No targets found.
Nov 29 14:57:34 user nova-compute[75215]: STATIC:
Nov 29 14:57:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:57:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:57:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:57:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597
Nov 29 14:57:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:57:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:57:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:57:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:57:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:57:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:57:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:57:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:57:34 user nova-compute[75215]: FIRMWARE:
Nov 29 14:57:34 user nova-compute[75215]: No targets found.
Nov 29 14:57:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:57:34 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:57:34 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a26573-bf2a-4c3c-9ce6-1a93d584b1d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ad56c-655d-42a9-a087-841fe421318c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)
Nov 29 14:57:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:34 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 (non-flash)
Nov 29 14:57:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac589360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae0637-b06b-448d-a376-3ed14e3df2a1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb70428e-6bcd-4619-acb3-f1d26f821e5c]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dae748-3e7c-4015-8aa9-e6044b4f24ef]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06917254-d657-4498-8d77-5f8ed20be941]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2783bc6-a3b8-4e11-9a60-64c17163f739]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec2e93-a97a-4040-8430-1dc6ead957b6]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260]
Nov 29 14:57:34 user nova-compute[75215]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597, portal: 172.16.0.220,3260] successful.
Nov 29 14:57:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccf8b8d-9aea-4c97-a354-0fa0ffb98597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e180e-4bca-4440-ba4d-f763137f3a5c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== disconnect_volume: return (354ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:57:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:57:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-48b8a13b-bfe6-4f14-95fa-d409556016bc tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing instance network info cache due to event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'flavor' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updated VIF entry in instance network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:46 user nova-compute[75215]: INFO nova.compute.manager [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Attaching volume d313a033-3a62-4649-911d-51e08c1a1086 to /dev/vdb
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fca90166-e2db-40ef-a77b-b62adf97b0c9 req-ffff36b2-a433-4da2-a9c9-742772b09c6b service nova] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.utils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35979e4-eeba-49ed-8216-0290317bcb33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b505d8e-2e63-4a18-a5f8-835b7409c4df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3364ffb-11a7-4e27-a2f1-df8caa8e4449]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2686c-2715-4608-8326-336b53bf6317]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:57:46 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:57:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506c9f3-1772-48c9-a63c-5b86001404ad]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG os_brick.utils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:57:46 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating existing volume attachment record: 40a0025e-6840-488a-b61a-7a9c1ae39d42 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:57:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUtCfoQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:57:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:57:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:57:54 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1525ca67-5aa5-471a-849a-ee739eac0853]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:57:54 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[05370879-634f-47e2-bb16-bdfe52e9b4fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086] added
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecacce4-47eb-44de-9714-7ffdb82e388e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb37108-d82b-446a-bfa6-b6b1e58c8a19]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUtCfoQM {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUtCfoQM" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5362a3c-c846-49ac-9495-ef509b1c17af]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUtCfoQM'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e53ad-a703-459b-9d8f-a5eee82dea60]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9749b153-baa9-464c-af4e-1e27991cd590]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511106f-0ee3-4132-9fad-38050d06ba2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260]
Nov 29 14:57:54 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260] successful.
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52a354-8964-4f6a-a06d-edcc0c6abe23]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a4b75-f70f-496f-a0b7-f1458159867d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:57:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f541db-07be-4a27-83da-323ef19884f2]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:57:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUtCfoQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23064353338326663', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064353338326663', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'flavor' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:57:55 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:57:55 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 14:57:55 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:57:55 user nova-compute[75215]:   <serial>d313a033-3a62-4649-911d-51e08c1a1086</serial>
Nov 29 14:57:55 user nova-compute[75215]: </disk>
Nov 29 14:57:55 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:1e:be:38, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:57:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dd4f98b-5653-41d9-a602-c8106f5b20ef tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:56 user nova-compute[75215]: INFO nova.compute.manager [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Rescuing
Nov 29 14:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:57:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:57 user nova-compute[75215]: WARNING nova.compute.manager [req-c0d6ad00-9a77-45a6-ba2a-ea5ed4516df3 req-54278590-9b64-4489-9354-f9b033a83a92 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state active and task_state rescuing.
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance destroyed successfully.
Nov 29 14:57:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Attempting rescue
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 14:57:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Creating image(s)
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'migration_context' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<9ced07bb-dd04-4b80-98ee-64afe84ea0ab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start _get_guest_xml network_info=[{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:1e:be:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<9ced07bb-dd04-4b80-98ee-64afe84ea0ab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<9ced07bb-dd04-4b80-98ee-64afe84ea0ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<9ced07bb-dd04-4b80-98ee-64afe84ea0ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717667989',display_name='tempest-ServerRescueNegativeTestJSON-server-717667989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-717667989',id=29,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELoWMOCpUjfVjdT3005LPYUzA+zNZ76VnwUzay/FWAhq1czPWHUfyoD4EDyLkdPFx7SBdFImuVyNTSpI617Ea7wdifORSar4tRDlUh4tYavPoBKHI9oArt84kwg2Eix0Q==',key_name='tempest-keypair-848980801',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-7ya4mxl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b4b269cff8f482cbbd277204b42585b',uuid=9ced07bb-dd04-4b80-98ee-64afe84ea0ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:1e:be:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "vif_mac": "fa:16:3e:1e:be:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Object Instance<9ced07bb-dd04-4b80-98ee-64afe84ea0ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:57:58 user nova-compute[75215]:   <uuid>9ced07bb-dd04-4b80-98ee-64afe84ea0ab</uuid>
Nov 29 14:57:58 user nova-compute[75215]:   <name>instance-0000001d</name>
Nov 29 14:57:58 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:57:58 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:57:58 user nova-compute[75215]:   <metadata>
Nov 29 14:57:58 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:57:58 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-717667989</nova:name>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:57:58</nova:creationTime>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:57:58 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:57:58 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:owner>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:user uuid="4b4b269cff8f482cbbd277204b42585b">tempest-ServerRescueNegativeTestJSON-1399489520-project-member</nova:user>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:project uuid="cf3e2fbd35cd4dc89ed674708af95612">tempest-ServerRescueNegativeTestJSON-1399489520</nova:project>
Nov 29 14:57:58 user nova-compute[75215]:       </nova:owner>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:57:58 user nova-compute[75215]:       <nova:ports>
Nov 29 14:57:58 user nova-compute[75215]:         <nova:port uuid="98c955ff-b257-4fd5-98d0-c75d3b63287f">
Nov 29 14:57:58 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 14:57:58 user nova-compute[75215]:         </nova:port>
Nov 29 14:57:58 user nova-compute[75215]:       </nova:ports>
Nov 29 14:57:58 user nova-compute[75215]:     </nova:instance>
Nov 29 14:57:58 user nova-compute[75215]:   </metadata>
Nov 29 14:57:58 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:57:58 user nova-compute[75215]:     <system>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="serial">9ced07bb-dd04-4b80-98ee-64afe84ea0ab</entry>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="uuid">9ced07bb-dd04-4b80-98ee-64afe84ea0ab</entry>
Nov 29 14:57:58 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:57:58 user nova-compute[75215]:     </system>
Nov 29 14:57:58 user nova-compute[75215]:   </sysinfo>
Nov 29 14:57:58 user nova-compute[75215]:   <os>
Nov 29 14:57:58 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:57:58 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:57:58 user nova-compute[75215]:   </os>
Nov 29 14:57:58 user nova-compute[75215]:   <features>
Nov 29 14:57:58 user nova-compute[75215]:     <acpi/>
Nov 29 14:57:58 user nova-compute[75215]:     <apic/>
Nov 29 14:57:58 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:57:58 user nova-compute[75215]:   </features>
Nov 29 14:57:58 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:57:58 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:57:58 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:57:58 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:57:58 user nova-compute[75215]:   </clock>
Nov 29 14:57:58 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:57:58 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:57:58 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:57:58 user nova-compute[75215]:   </cpu>
Nov 29 14:57:58 user nova-compute[75215]:   <devices>
Nov 29 14:57:58 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:57:58 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:57:58 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue"/>
Nov 29 14:57:58 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:57:58 user nova-compute[75215]:     </disk>
Nov 29 14:57:58 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:57:58 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:57:58 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk"/>
Nov 29 14:57:58 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 14:57:58 user nova-compute[75215]:     </disk>
Nov 29 14:57:58 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:57:58 user nova-compute[75215]:       <mac address="fa:16:3e:1e:be:38"/>
Nov 29 14:57:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:57:58 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:57:58 user nova-compute[75215]:       <target dev="tap98c955ff-b2"/>
Nov 29 14:57:58 user nova-compute[75215]:     </interface>
Nov 29 14:57:58 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:57:58 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/console.log" append="off"/>
Nov 29 14:57:58 user nova-compute[75215]:     </serial>
Nov 29 14:57:58 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:57:58 user nova-compute[75215]:     <video>
Nov 29 14:57:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:57:58 user nova-compute[75215]:     </video>
Nov 29 14:57:58 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:57:58 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:57:58 user nova-compute[75215]:     </rng>
Nov 29 14:57:58 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:57:58 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:57:58 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:57:58 user nova-compute[75215]:     </memballoon>
Nov 29 14:57:58 user nova-compute[75215]:   </devices>
Nov 29 14:57:58 user nova-compute[75215]: </domain>
Nov 29 14:57:58 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:57:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance destroyed successfully.
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] No VIF found with MAC fa:16:3e:1e:be:38, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:57:59 user nova-compute[75215]: WARNING nova.compute.manager [req-e97e0b3f-54b6-44c0-923b-5fa58ee7599f req-cbb124a9-caf7-4fda-824e-e8176a932080 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state active and task_state rescuing.
Nov 29 14:57:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:57:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:01 user nova-compute[75215]: WARNING nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state active and task_state rescuing.
Nov 29 14:58:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:01 user nova-compute[75215]: WARNING nova.compute.manager [req-8b6366ff-e14e-46ad-a3cb-1a691c3353ce req-9ab9774c-adec-4f6d-8f33-3dc3ed21aa47 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state active and task_state rescuing.
Nov 29 14:58:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f54e0265-16c1-4e77-9c61-d2a3a0174c2b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:58:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.compute.manager [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Terminating instance
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-unplugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] No waiting events found dispatching network-vif-unplugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-199dc5d7-fdad-41dd-9a42-2dd3cac715f2 req-e2d922e1-a6d7-48a3-bd4a-aba35e9fd123 service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-unplugged-2c36b828-a881-4bde-8076-9eec4e3eec2b for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.compute.manager [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Detaching volume b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.virt.block_device [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Attempting to driver detach volume b4326ca7-174a-483f-9ef7-451b705bbc4e from mountpoint /dev/vdb
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Instance destroyed successfully.
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'resources' on Instance uuid b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Attempting to detach device vdb from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:58:04 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:58:04 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:58:04 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:58:04 user nova-compute[75215]:   <serial>b4326ca7-174a-483f-9ef7-451b705bbc4e</serial>
Nov 29 14:58:04 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:58:04 user nova-compute[75215]: </disk>
Nov 29 14:58:04 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2103859116',display_name='tempest-AttachVolumeNegativeTest-server-2103859116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2103859116',id=28,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7xC70v0AYlDYYd0MOur9CUyPSoO0hIW22MeQT7j6otux6uRnZRSGWrCu1p1TOmTx7TwhoMJAeUhrtyHbXFKh1Jy7730L8Sxx0BHAOC8tAXXtvBhKHzVOLF+iQl5H2Z/w==',key_name='tempest-keypair-449157508',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7i0qzq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "address": "fa:16:3e:99:00:e6", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c36b828-a8", "ovs_interfaceid": "2c36b828-a881-4bde-8076-9eec4e3eec2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG os_vif [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c36b828-a8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully detached device vdb from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the persistent domain config.
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:58:04 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:58:04 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 14:58:04 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:58:04 user nova-compute[75215]:   <serial>b4326ca7-174a-483f-9ef7-451b705bbc4e</serial>
Nov 29 14:58:04 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 14:58:04 user nova-compute[75215]: </disk>
Nov 29 14:58:04 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=071d7d67-07d1-4215-ad51-1e9d6c1b1a25) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:04 user nova-compute[75215]: INFO os_vif [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:00:e6,bridge_name='br-int',has_traffic_filtering=True,id=2c36b828-a881-4bde-8076-9eec4e3eec2b,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c36b828-a8')
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Deleting instance files /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4_del
Nov 29 14:58:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Deletion of /opt/stack/data/nova/instances/b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4_del complete
Nov 29 14:58:05 user nova-compute[75215]: INFO nova.compute.manager [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:05 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Took 0.87 seconds to deallocate network for instance.
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:06 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Deleted allocations for instance b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-483e2b5f-6abd-445f-b450-14978c0245b5 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] Acquiring lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] Lock "b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] No waiting events found dispatching network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:06 user nova-compute[75215]: WARNING nova.compute.manager [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received unexpected event network-vif-plugged-2c36b828-a881-4bde-8076-9eec4e3eec2b for instance with vm_state deleted and task_state None.
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9b9263c7-f6f1-4152-a5f0-33b86115478d req-16dc72cb-f28e-4380-bd30-26503ec0811c service nova] [instance: b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4] Received event network-vif-deleted-2c36b828-a881-4bde-8076-9eec4e3eec2b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b45da0fb-0c1b-4d5b-807d-1fd33cbbe8e4' (instance-0000001c)
Nov 29 14:58:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:58:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=24.744808197021484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 25d981de-63c5-4012-8f38-fca174d1f3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 27e9c891-3fb0-424a-b6b1-22a123c18271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:11 user nova-compute[75215]: INFO nova.compute.manager [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Terminating instance
Nov 29 14:58:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bbf21cb-a439-4e65-ad9f-5c2c3fac3a59 req-9b27b50e-356c-4ea4-90c0-827bf9aad2a4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-unplugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Instance destroyed successfully.
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lazy-loading 'resources' on Instance uuid a4d29026-19d4-4558-b8fe-a56b1bb81a1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2011968674',display_name='tempest-ServerActionsTestOtherB-server-2011968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2011968674',id=20,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPc/MUOeWWYbT0kDbEPezj7hhn8fZ8WMSIeMH2aXU4rOewQHEki32Y8JrdA8BVBc9jn5c1zonbFDjoXXxx13wzw3kICRucX4clXB+CLiVjPla4NiDV+mDYUA20jwLZzNg==',key_name='tempest-keypair-2026194003',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2714f996f4404fd5a282aa4866064738',ramdisk_id='',reservation_id='r-crynr7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-291681319',owner_user_name='tempest-ServerActionsTestOtherB-291681319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17839d64f1ee42528d08a7d00cd3159d',uuid=a4d29026-19d4-4558-b8fe-a56b1bb81a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converting VIF {"id": "9c699603-deba-4c85-a935-74136b77ed44", "address": "fa:16:3e:c6:77:67", "network": {"id": "61f21c2e-c852-4da7-9a0d-ecdf627d7d1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-359200416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2714f996f4404fd5a282aa4866064738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c699603-de", "ovs_interfaceid": "9c699603-deba-4c85-a935-74136b77ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_vif [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c699603-de, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c2bddf8-2d60-4912-86e4-bd5b31b05e22) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:12 user nova-compute[75215]: INFO os_vif [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:77:67,bridge_name='br-int',has_traffic_filtering=True,id=9c699603-deba-4c85-a935-74136b77ed44,network=Network(61f21c2e-c852-4da7-9a0d-ecdf627d7d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c699603-de')
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APEYijve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:58:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb81d5-7405-4ba5-b8d6-0b6a16a37dac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:58:12 user nova-compute[75215]: No targets found.
Nov 29 14:58:12 user nova-compute[75215]: iSNS:
Nov 29 14:58:12 user nova-compute[75215]: No targets found.
Nov 29 14:58:12 user nova-compute[75215]: STATIC:
Nov 29 14:58:12 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:58:12 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:12 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:12 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:58:12 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:12 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:12 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086
Nov 29 14:58:12 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:12 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:12 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286
Nov 29 14:58:12 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:12 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:12 user nova-compute[75215]: FIRMWARE:
Nov 29 14:58:12 user nova-compute[75215]: No targets found.
Nov 29 14:58:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:58:12 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:58:12 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab889c07-f10c-4de1-9cd4-ac5a5d410985]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c2e579-d891-4577-845e-28e4398d1ebc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:58:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 (non-flash)
Nov 29 14:58:12 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:58:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac3a9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46614b2-924b-4c92-9fed-0fe346a267d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdb2e1-eaf7-4d66-a7f2-6486f04eb85e]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9b9df-f9d3-496a-893a-db81d5b42dd0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ae6e1-dd4b-4612-a895-598aedeed34a]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbaebab-6033-40c5-bbc4-fe3ec07dbe0e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d56a9-9e57-4ed8-8f6b-e936be1ba879]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260]
Nov 29 14:58:12 user nova-compute[75215]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286, portal: 172.16.0.220,3260] successful.
Nov 29 14:58:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad3b9cd-e702-40d1-818f-9a7d0a032286 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099b099-1888-4acf-b0c7-0c5647ddce06]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] <== disconnect_volume: return (322ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:58:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:58:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Deleting instance files /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_del
Nov 29 14:58:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Deletion of /opt/stack/data/nova/instances/a4d29026-19d4-4558-b8fe-a56b1bb81a1e_del complete
Nov 29 14:58:13 user nova-compute[75215]: INFO nova.compute.manager [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 14:58:13 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:58:13 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:58:13 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:14 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Took 1.06 seconds to deallocate network for instance.
Nov 29 14:58:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-f814d69e-7799-4c5f-a500-796c37eb2f2b req-447b3eb8-ee50-4c71-a54e-8f1e8cd7fba2 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-deleted-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] Acquiring lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] No waiting events found dispatching network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:14 user nova-compute[75215]: WARNING nova.compute.manager [req-72c31a07-14f8-4556-8820-2e19e2530ce6 req-31c18955-ff3d-490d-80ef-40281c6fedc4 service nova] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Received unexpected event network-vif-plugged-9c699603-deba-4c85-a935-74136b77ed44 for instance with vm_state active and task_state deleting.
Nov 29 14:58:14 user nova-compute[75215]: INFO nova.compute.manager [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] [instance: a4d29026-19d4-4558-b8fe-a56b1bb81a1e] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 14:58:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:15 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Deleted allocations for instance a4d29026-19d4-4558-b8fe-a56b1bb81a1e
Nov 29 14:58:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56e15824-2641-4f82-9d78-01bba5c7eb48 tempest-ServerActionsTestOtherB-291681319 tempest-ServerActionsTestOtherB-291681319-project-member] Lock "a4d29026-19d4-4558-b8fe-a56b1bb81a1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.685s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:58:16 user nova-compute[75215]: INFO nova.compute.claims [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Claim successful on node user
Nov 29 14:58:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:58:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.policy [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fad9c93f4ea491880e3cd7a97518367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72c331f6f384976bc971f9318b7d0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:58:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Creating image(s)
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "/opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk 1073741824" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Successfully created port: d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Cannot resize image /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Ensure instance console log exists: /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Successfully updated port: d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-changed-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Refreshing instance network info cache due to event network-changed-d2efb058-f840-43df-8b90-c73ecb76ba17. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] Acquiring lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updating instance_info_cache with network_info: [{"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Instance network_info: |[{"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] Acquired lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Refreshing network info cache for port d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Start _get_guest_xml network_info=[{"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:58:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:58:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1456921760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1456921760',id=31,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-z701s246',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:58:17Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=6162fc1b-1263-475f-93ae-ed82d35b5c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid 6162fc1b-1263-475f-93ae-ed82d35b5c1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:58:18 user nova-compute[75215]:   <uuid>6162fc1b-1263-475f-93ae-ed82d35b5c1e</uuid>
Nov 29 14:58:18 user nova-compute[75215]:   <name>instance-0000001f</name>
Nov 29 14:58:18 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:58:18 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:58:18 user nova-compute[75215]:   <metadata>
Nov 29 14:58:18 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:58:18 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1456921760</nova:name>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:58:18</nova:creationTime>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:58:18 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:58:18 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:owner>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 14:58:18 user nova-compute[75215]:       </nova:owner>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:58:18 user nova-compute[75215]:       <nova:ports>
Nov 29 14:58:18 user nova-compute[75215]:         <nova:port uuid="d2efb058-f840-43df-8b90-c73ecb76ba17">
Nov 29 14:58:18 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 14:58:18 user nova-compute[75215]:         </nova:port>
Nov 29 14:58:18 user nova-compute[75215]:       </nova:ports>
Nov 29 14:58:18 user nova-compute[75215]:     </nova:instance>
Nov 29 14:58:18 user nova-compute[75215]:   </metadata>
Nov 29 14:58:18 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:58:18 user nova-compute[75215]:     <system>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="serial">6162fc1b-1263-475f-93ae-ed82d35b5c1e</entry>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="uuid">6162fc1b-1263-475f-93ae-ed82d35b5c1e</entry>
Nov 29 14:58:18 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:58:18 user nova-compute[75215]:     </system>
Nov 29 14:58:18 user nova-compute[75215]:   </sysinfo>
Nov 29 14:58:18 user nova-compute[75215]:   <os>
Nov 29 14:58:18 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:58:18 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:58:18 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:58:18 user nova-compute[75215]:   </os>
Nov 29 14:58:18 user nova-compute[75215]:   <features>
Nov 29 14:58:18 user nova-compute[75215]:     <acpi/>
Nov 29 14:58:18 user nova-compute[75215]:     <apic/>
Nov 29 14:58:18 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:58:18 user nova-compute[75215]:   </features>
Nov 29 14:58:18 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:58:18 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:58:18 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:58:18 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:58:18 user nova-compute[75215]:   </clock>
Nov 29 14:58:18 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:58:18 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:58:18 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:58:18 user nova-compute[75215]:   </cpu>
Nov 29 14:58:18 user nova-compute[75215]:   <devices>
Nov 29 14:58:18 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:58:18 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:58:18 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk"/>
Nov 29 14:58:18 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:58:18 user nova-compute[75215]:     </disk>
Nov 29 14:58:18 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:58:18 user nova-compute[75215]:       <mac address="fa:16:3e:59:0e:0b"/>
Nov 29 14:58:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:58:18 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:58:18 user nova-compute[75215]:       <target dev="tapd2efb058-f8"/>
Nov 29 14:58:18 user nova-compute[75215]:     </interface>
Nov 29 14:58:18 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:58:18 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/console.log" append="off"/>
Nov 29 14:58:18 user nova-compute[75215]:     </serial>
Nov 29 14:58:18 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:58:18 user nova-compute[75215]:     <video>
Nov 29 14:58:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:58:18 user nova-compute[75215]:     </video>
Nov 29 14:58:18 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:58:18 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:58:18 user nova-compute[75215]:     </rng>
Nov 29 14:58:18 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:58:18 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:58:18 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:58:18 user nova-compute[75215]:     </memballoon>
Nov 29 14:58:18 user nova-compute[75215]:   </devices>
Nov 29 14:58:18 user nova-compute[75215]: </domain>
Nov 29 14:58:18 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1456921760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1456921760',id=31,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-z701s246',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:58:17Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=6162fc1b-1263-475f-93ae-ed82d35b5c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG os_vif [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b17495bf-38c9-5a29-b5fe-520587aed0a5', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2efb058-f8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2efb058-f8, col_values=(('qos', UUID('3409b81d-9c5e-426d-8802-a0fdd8d90e2f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2efb058-f8, col_values=(('external_ids', {'iface-id': 'd2efb058-f840-43df-8b90-c73ecb76ba17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:0e:0b', 'vm-uuid': '6162fc1b-1263-475f-93ae-ed82d35b5c1e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:18 user nova-compute[75215]: INFO os_vif [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8')
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:59:0e:0b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updated VIF entry in instance network info cache for port d2efb058-f840-43df-8b90-c73ecb76ba17. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updating instance_info_cache with network_info: [{"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c6c74909-2562-4572-b156-ef2df7f66a0f req-ab247908-b1bb-4ceb-bc9e-40334a232451 service nova] Releasing lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:58:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] No waiting events found dispatching network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:20 user nova-compute[75215]: WARNING nova.compute.manager [req-4cd779da-bf1b-4be5-ad0e-00a70fb5dd15 req-a2b185ae-9e8b-46f1-a7bf-d05df777d8b6 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received unexpected event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 for instance with vm_state building and task_state spawning.
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:58:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Instance spawned successfully.
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:58:22 user nova-compute[75215]: INFO nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:58:22 user nova-compute[75215]: INFO nova.compute.manager [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Took 6.22 seconds to build instance.
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] No waiting events found dispatching network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:22 user nova-compute[75215]: WARNING nova.compute.manager [req-7fc095e7-e668-486c-8363-8951c551c701 req-363913a5-8bae-49a4-a549-898ccfa294e2 service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received unexpected event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 for instance with vm_state active and task_state None.
Nov 29 14:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32585a62-c83e-4f38-aa49-983fb16a4635 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.310s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 is timed out.
Nov 29 14:58:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully detached device vdb from instance 27e9c891-3fb0-424a-b6b1-22a123c18271 from the live domain config.
Nov 29 14:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKYvlcuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:58:25 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ec8ca-d12d-43e7-b165-cf3085085f24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:58:25 user nova-compute[75215]: No targets found.
Nov 29 14:58:25 user nova-compute[75215]: iSNS:
Nov 29 14:58:25 user nova-compute[75215]: No targets found.
Nov 29 14:58:25 user nova-compute[75215]: STATIC:
Nov 29 14:58:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 14:58:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e
Nov 29 14:58:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086
Nov 29 14:58:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:58:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 14:58:25 user nova-compute[75215]: FIRMWARE:
Nov 29 14:58:25 user nova-compute[75215]: No targets found.
Nov 29 14:58:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:58:25 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:58:25 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722c053-edfc-45a2-8925-335088a0082d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06204617-cc77-435d-9a23-0fcf6e77935a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:58:25 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:58:25 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:58:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 14:58:25 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e (non-flash)
Nov 29 14:58:25 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 14:58:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885abac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d4aa3-b785-43e3-8ecd-16892b83af40]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[266fd41d-3613-41cc-a8a5-d37fd700ba88]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c752fcf-6328-42e9-a885-362380074dbd]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de635903-5b3a-494d-86ad-099b92cbc3d1]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c776d3b-7121-49e7-a63a-1691a9747ad4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca38e8-dcb8-42a6-994b-e1bb9b628677]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260]
Nov 29 14:58:25 user nova-compute[75215]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e, portal: 172.16.0.220,3260] successful.
Nov 29 14:58:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4326ca7-174a-483f-9ef7-451b705bbc4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a32f25-2e6c-442c-93dc-b3b6145c4ff2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== disconnect_volume: return (347ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:58:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'flavor' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c45d55a3-07fd-4e0f-a380-b9788977b540 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:45 user nova-compute[75215]: INFO nova.compute.manager [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Terminating instance
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-unplugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] No waiting events found dispatching network-vif-unplugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-a40ae088-8bcb-4465-a818-166024edc564 req-4a45924d-43d5-437b-90b2-87dfc17e0ce9 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-unplugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:58:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Instance destroyed successfully.
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lazy-loading 'resources' on Instance uuid 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1628489158',display_name='tempest-VolumesActionsTest-instance-1628489158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1628489158',id=30,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6bb0db9ad84e11b601e33faec86430',ramdisk_id='',reservation_id='r-wrnn66q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1497530955',owner_user_name='tempest-VolumesActionsTest-1497530955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:57:02Z,user_data=None,user_id='49aba78eccc74f9fa31f33a8199d3aff',uuid=6875f564-d0c8-4ddc-8e15-0d5aa52ef31b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converting VIF {"id": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "address": "fa:16:3e:1a:29:b7", "network": {"id": "59242819-a000-4b45-b8a0-994476ff44ec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1314298793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6bb0db9ad84e11b601e33faec86430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c4255a-01", "ovs_interfaceid": "b4c4255a-012d-4cca-a1ef-9287f1b4604a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG os_vif [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4c4255a-01, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcadbe1b-4b86-47e7-9862-fe3bd2c2db8f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:45 user nova-compute[75215]: INFO os_vif [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4c4255a-012d-4cca-a1ef-9287f1b4604a,network=Network(59242819-a000-4b45-b8a0-994476ff44ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c4255a-01')
Nov 29 14:58:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Deleting instance files /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b_del
Nov 29 14:58:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Deletion of /opt/stack/data/nova/instances/6875f564-d0c8-4ddc-8e15-0d5aa52ef31b_del complete
Nov 29 14:58:45 user nova-compute[75215]: INFO nova.compute.manager [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 14:58:45 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:58:45 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:46 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Took 0.55 seconds to deallocate network for instance.
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-df04796b-5554-4498-9567-233c70abf0bf req-fefa20b9-90a6-4381-8ab9-ee375993a229 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-deleted-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:46 user nova-compute[75215]: INFO nova.compute.manager [req-df04796b-5554-4498-9567-233c70abf0bf req-fefa20b9-90a6-4381-8ab9-ee375993a229 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Neutron deleted interface b4c4255a-012d-4cca-a1ef-9287f1b4604a; detaching it from the instance and deleting it from the info cache
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-df04796b-5554-4498-9567-233c70abf0bf req-fefa20b9-90a6-4381-8ab9-ee375993a229 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-df04796b-5554-4498-9567-233c70abf0bf req-fefa20b9-90a6-4381-8ab9-ee375993a229 service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Detach interface failed, port_id=b4c4255a-012d-4cca-a1ef-9287f1b4604a, reason: Instance 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:46 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Deleted allocations for instance 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b
Nov 29 14:58:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-32f6c2aa-3c72-41ce-8654-ba2d6d55cd2d tempest-VolumesActionsTest-1497530955 tempest-VolumesActionsTest-1497530955-project-member] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] Acquiring lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] Lock "6875f564-d0c8-4ddc-8e15-0d5aa52ef31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] No waiting events found dispatching network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:47 user nova-compute[75215]: WARNING nova.compute.manager [req-9f52e5a1-4377-452f-a118-6465ccbd4ed7 req-d6d1a983-7ad6-42c1-9b70-9de896c65ebd service nova] [instance: 6875f564-d0c8-4ddc-8e15-0d5aa52ef31b] Received unexpected event network-vif-plugged-b4c4255a-012d-4cca-a1ef-9287f1b4604a for instance with vm_state deleted and task_state None.
Nov 29 14:58:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:55 user nova-compute[75215]: INFO nova.compute.manager [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Terminating instance
Nov 29 14:58:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:55 user nova-compute[75215]: INFO nova.compute.manager [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Terminating instance
Nov 29 14:58:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad8f328f-b066-4f80-ab54-032b07640263 req-54edb825-2433-4850-9109-ced5a4aac541 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-unplugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Instance destroyed successfully.
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'resources' on Instance uuid 27e9c891-3fb0-424a-b6b1-22a123c18271 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Instance destroyed successfully.
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'resources' on Instance uuid 25d981de-63c5-4012-8f38-fca174d1f3f7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T14:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-969477839',display_name='tempest-ServerActionsTestOtherA-server-2026751555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-969477839',id=25,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcXWKBxb4kzXomuxsGN3jIa9Vg4L2tVq7F66cupD3XaLZuPhdzoG7d4Pu3FhDoQXCS8xsHi/BAtpHIwsqzRtvfpJ+Sd38yFHGkpjRD5CElCXhhSYXQMqK1ZbgXI1AJDfA==',key_name='tempest-keypair-982972370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-ou5wfr23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=27e9c891-3fb0-424a-b6b1-22a123c18271,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "address": "fa:16:3e:26:97:ce", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b5aaa0-36", "ovs_interfaceid": "85b5aaa0-3670-49a7-9244-6d1fb48ff135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG os_vif [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85b5aaa0-36, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-612258283',display_name='tempest-AttachVolumeTestJSON-server-612258283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-612258283',id=18,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWL7Iesitxwiu2fo51xccP3cPRZwHlJvCSxQvjkqpTnx2cLLxZPR8x3LjCMwi1NX9zbgdb6wdi7dEXinld1Nv07udFYgPDPhSLUEj1vj0Jk/WCDeSwAbuGYaFEDGNmNg==',key_name='tempest-keypair-1620087123',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-dis400y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=25d981de-63c5-4012-8f38-fca174d1f3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "2e908e58-ac66-489e-b05c-69fcccc1f750", "address": "fa:16:3e:85:ed:19", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e908e58-ac", "ovs_interfaceid": "2e908e58-ac66-489e-b05c-69fcccc1f750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG os_vif [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e908e58-ac, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c2ed3e-4058-40e7-bc80-88b8845d49d2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7f8eb6f-fdb7-4653-acb2-a252c7a94a1f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: INFO os_vif [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:97:ce,bridge_name='br-int',has_traffic_filtering=True,id=85b5aaa0-3670-49a7-9244-6d1fb48ff135,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b5aaa0-36')
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Deleting instance files /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271_del
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Deletion of /opt/stack/data/nova/instances/27e9c891-3fb0-424a-b6b1-22a123c18271_del complete
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: INFO os_vif [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ed:19,bridge_name='br-int',has_traffic_filtering=True,id=2e908e58-ac66-489e-b05c-69fcccc1f750,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e908e58-ac')
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Deleting instance files /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7_del
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Deletion of /opt/stack/data/nova/instances/25d981de-63c5-4012-8f38-fca174d1f3f7_del complete
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.compute.manager [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 29 14:58:56 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:58:56 user nova-compute[75215]: INFO nova.compute.manager [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 29 14:58:56 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Acquiring lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] No waiting events found dispatching network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:58 user nova-compute[75215]: WARNING nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received unexpected event network-vif-plugged-85b5aaa0-3670-49a7-9244-6d1fb48ff135 for instance with vm_state active and task_state deleting.
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-unplugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Acquiring lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] No waiting events found dispatching network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:58:58 user nova-compute[75215]: WARNING nova.compute.manager [req-483220fe-00af-430c-a58c-4ba4960bf907 req-82297793-f6a9-4b03-ae97-875d140e4e48 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received unexpected event network-vif-plugged-2e908e58-ac66-489e-b05c-69fcccc1f750 for instance with vm_state active and task_state deleting.
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:58 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Took 2.05 seconds to deallocate network for instance.
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:58:58 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Took 2.22 seconds to deallocate network for instance.
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.241s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:58 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Deleted allocations for instance 27e9c891-3fb0-424a-b6b1-22a123c18271
Nov 29 14:58:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-44c3281e-bfc1-4f78-b9ac-efba6fe74602 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "27e9c891-3fb0-424a-b6b1-22a123c18271" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.923s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:59 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Deleted allocations for instance 25d981de-63c5-4012-8f38-fca174d1f3f7
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-54f88336-2078-471f-87fe-414e98842db7 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "25d981de-63c5-4012-8f38-fca174d1f3f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.992s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:58:59 user nova-compute[75215]: INFO nova.compute.claims [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Claim successful on node user
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:58:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:59:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.policy [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd88477198b5d411f9e193afdb9f40e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e6a6477d6b4664a2f0de1b0bdc15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4b31ff2-8c3c-4437-a8c0-809994e0ea9b req-4fe53cb5-4a29-47b5-9a79-da6720ee8dd8 service nova] [instance: 27e9c891-3fb0-424a-b6b1-22a123c18271] Received event network-vif-deleted-85b5aaa0-3670-49a7-9244-6d1fb48ff135 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4b31ff2-8c3c-4437-a8c0-809994e0ea9b req-4fe53cb5-4a29-47b5-9a79-da6720ee8dd8 service nova] [instance: 25d981de-63c5-4012-8f38-fca174d1f3f7] Received event network-vif-deleted-2e908e58-ac66-489e-b05c-69fcccc1f750 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:59:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Creating image(s)
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "/opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk 1073741824" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:59:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Successfully created port: 19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Cannot resize image /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Ensure instance console log exists: /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Successfully updated port: 19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquired lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:59:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updating instance_info_cache with network_info: [{"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Releasing lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Instance network_info: |[{"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Start _get_guest_xml network_info=[{"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:59:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-147484494',display_name='tempest-AttachVolumeNegativeTest-server-147484494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-147484494',id=32,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNKmhx7wcuUGYWnf5t+i9E2DD2qc4qGewMQrTKWtX9sBS1GdDbZrnVAFynsSK3Ykri2lRVJNAqwo9xHjTiMfLaVx80Md9u8Df1asxdp6Hw+w5R3PMuh3asMpMidQhDRTw==',key_name='tempest-keypair-1179512799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7hv8b45w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=a2453a5b-c323-445a-b680-5dad2690b08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'pci_devices' on Instance uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:59:02 user nova-compute[75215]:   <uuid>a2453a5b-c323-445a-b680-5dad2690b08a</uuid>
Nov 29 14:59:02 user nova-compute[75215]:   <name>instance-00000020</name>
Nov 29 14:59:02 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:59:02 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:59:02 user nova-compute[75215]:   <metadata>
Nov 29 14:59:02 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:59:02 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-147484494</nova:name>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:59:02</nova:creationTime>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:59:02 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:59:02 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:owner>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:user uuid="d88477198b5d411f9e193afdb9f40e03">tempest-AttachVolumeNegativeTest-1682890616-project-member</nova:user>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:project uuid="35e6a6477d6b4664a2f0de1b0bdc15e2">tempest-AttachVolumeNegativeTest-1682890616</nova:project>
Nov 29 14:59:02 user nova-compute[75215]:       </nova:owner>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:59:02 user nova-compute[75215]:       <nova:ports>
Nov 29 14:59:02 user nova-compute[75215]:         <nova:port uuid="19d9b82b-929a-41bb-be01-f10b8d947277">
Nov 29 14:59:02 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 14:59:02 user nova-compute[75215]:         </nova:port>
Nov 29 14:59:02 user nova-compute[75215]:       </nova:ports>
Nov 29 14:59:02 user nova-compute[75215]:     </nova:instance>
Nov 29 14:59:02 user nova-compute[75215]:   </metadata>
Nov 29 14:59:02 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:59:02 user nova-compute[75215]:     <system>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="serial">a2453a5b-c323-445a-b680-5dad2690b08a</entry>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="uuid">a2453a5b-c323-445a-b680-5dad2690b08a</entry>
Nov 29 14:59:02 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:59:02 user nova-compute[75215]:     </system>
Nov 29 14:59:02 user nova-compute[75215]:   </sysinfo>
Nov 29 14:59:02 user nova-compute[75215]:   <os>
Nov 29 14:59:02 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:59:02 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:59:02 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:59:02 user nova-compute[75215]:   </os>
Nov 29 14:59:02 user nova-compute[75215]:   <features>
Nov 29 14:59:02 user nova-compute[75215]:     <acpi/>
Nov 29 14:59:02 user nova-compute[75215]:     <apic/>
Nov 29 14:59:02 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:59:02 user nova-compute[75215]:   </features>
Nov 29 14:59:02 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:59:02 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:59:02 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:59:02 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:59:02 user nova-compute[75215]:   </clock>
Nov 29 14:59:02 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:59:02 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:59:02 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:59:02 user nova-compute[75215]:   </cpu>
Nov 29 14:59:02 user nova-compute[75215]:   <devices>
Nov 29 14:59:02 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:59:02 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:59:02 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk"/>
Nov 29 14:59:02 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:59:02 user nova-compute[75215]:     </disk>
Nov 29 14:59:02 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:59:02 user nova-compute[75215]:       <mac address="fa:16:3e:18:79:87"/>
Nov 29 14:59:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:59:02 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:59:02 user nova-compute[75215]:       <target dev="tap19d9b82b-92"/>
Nov 29 14:59:02 user nova-compute[75215]:     </interface>
Nov 29 14:59:02 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:59:02 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/console.log" append="off"/>
Nov 29 14:59:02 user nova-compute[75215]:     </serial>
Nov 29 14:59:02 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:59:02 user nova-compute[75215]:     <video>
Nov 29 14:59:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:59:02 user nova-compute[75215]:     </video>
Nov 29 14:59:02 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:59:02 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:59:02 user nova-compute[75215]:     </rng>
Nov 29 14:59:02 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:59:02 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:59:02 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:59:02 user nova-compute[75215]:     </memballoon>
Nov 29 14:59:02 user nova-compute[75215]:   </devices>
Nov 29 14:59:02 user nova-compute[75215]: </domain>
Nov 29 14:59:02 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-147484494',display_name='tempest-AttachVolumeNegativeTest-server-147484494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-147484494',id=32,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNKmhx7wcuUGYWnf5t+i9E2DD2qc4qGewMQrTKWtX9sBS1GdDbZrnVAFynsSK3Ykri2lRVJNAqwo9xHjTiMfLaVx80Md9u8Df1asxdp6Hw+w5R3PMuh3asMpMidQhDRTw==',key_name='tempest-keypair-1179512799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7hv8b45w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=a2453a5b-c323-445a-b680-5dad2690b08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG os_vif [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4135944-f0c7-5c80-80de-7bb2e0f8c79f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-changed-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Refreshing instance network info cache due to event network-changed-19d9b82b-929a-41bb-be01-f10b8d947277. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] Acquiring lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] Acquired lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Refreshing network info cache for port 19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19d9b82b-92, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19d9b82b-92, col_values=(('qos', UUID('f801e12b-76fa-4079-8573-be6c843b0ef3')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19d9b82b-92, col_values=(('external_ids', {'iface-id': '19d9b82b-929a-41bb-be01-f10b8d947277', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:79:87', 'vm-uuid': 'a2453a5b-c323-445a-b680-5dad2690b08a'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:02 user nova-compute[75215]: INFO os_vif [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92')
Nov 29 14:59:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:18:79:87, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updated VIF entry in instance network info cache for port 19d9b82b-929a-41bb-be01-f10b8d947277. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updating instance_info_cache with network_info: [{"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:59:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-492c0eea-fc8d-4c3f-aa0b-9874f3987943 req-c565c539-2fd7-485c-8a0d-c5071dba828a service nova] Releasing lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:59:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] No waiting events found dispatching network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:04 user nova-compute[75215]: WARNING nova.compute.manager [req-e23a6efc-33c9-4b40-b8b1-03375107c572 req-0e273a24-1458-440e-a70c-a7898d6a8f79 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received unexpected event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 for instance with vm_state building and task_state spawning.
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:59:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:59:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Instance spawned successfully.
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:06 user nova-compute[75215]: INFO nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:06 user nova-compute[75215]: INFO nova.compute.manager [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Took 6.74 seconds to build instance.
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d15d6ffb-e915-4a23-8575-4fd05e8adfc2 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.868s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] No waiting events found dispatching network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:06 user nova-compute[75215]: WARNING nova.compute.manager [req-8bbc2c88-803d-458f-9c0b-4f64654b9b58 req-4ac724db-f342-456d-9118-db51445582fc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received unexpected event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 for instance with vm_state active and task_state None.
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8047MB free_disk=24.85085678100586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a2453a5b-c323-445a-b680-5dad2690b08a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:59:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:59:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:47 user nova-compute[75215]: INFO nova.compute.manager [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Unrescuing
Nov 29 14:59:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:59:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'flavor' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:49 user nova-compute[75215]: WARNING nova.compute.manager [req-34ed3fa4-178a-459c-8264-6dc94f7d136c req-44d2541d-932a-4484-ae3b-8f1bd6454572 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:59:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance destroyed successfully.
Nov 29 14:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:59:50 user nova-compute[75215]: INFO nova.compute.claims [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Claim successful on node user
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:59:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:59:50 user nova-compute[75215]: DEBUG nova.policy [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc31705a39b4447a3ad96ca8d073144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0dc3e9a4bc447a80d5983bbafe3059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:59:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Creating image(s)
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "/opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "/opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:51 user nova-compute[75215]: WARNING nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:51 user nova-compute[75215]: WARNING nova.compute.manager [req-ab60602d-d01c-4b66-a82d-8970b37308c4 req-686452e4-9357-4f98-9a46-7123c8566d0e service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state rescued and task_state unrescuing.
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk 1073741824" returned: 0 in 0.057s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Successfully created port: 14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Cannot resize image /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Ensure instance console log exists: /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Successfully updated port: 14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquired lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-changed-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Refreshing instance network info cache due to event network-changed-14ddadbd-807d-436c-b3a8-ca80400263e5. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] Acquiring lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating instance_info_cache with network_info: [{"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Releasing lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Instance network_info: |[{"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] Acquired lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Refreshing network info cache for port 14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:59:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Start _get_guest_xml network_info=[{"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d59332af-36c1-4eb3-94fe-cb0f7bc6e4d0 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:59:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-568374541',display_name='tempest-AttachVolumeTestJSON-server-568374541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-568374541',id=33,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOfYdAeNFyFZILI1mRQVmBrtB0a1QbTXR4QSM3LWRIor6RFuIJeH2hqL3lpxOTx/4eqd6GGZsUPCvXbINY8jagQubh0xnYyu9fjBxaF3K6R9chMf4+C8RWbrbCiBg+kDQ==',key_name='tempest-keypair-397499663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-5ru00k1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=8ee90a2c-a7ec-443b-b913-33db128f07dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:59:53 user nova-compute[75215]:   <uuid>8ee90a2c-a7ec-443b-b913-33db128f07dc</uuid>
Nov 29 14:59:53 user nova-compute[75215]:   <name>instance-00000021</name>
Nov 29 14:59:53 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 14:59:53 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 14:59:53 user nova-compute[75215]:   <metadata>
Nov 29 14:59:53 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:59:53 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-568374541</nova:name>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:creationTime>2023-11-29 14:59:53</nova:creationTime>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 14:59:53 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:59:53 user nova-compute[75215]:       </nova:flavor>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:owner>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:user uuid="bfc31705a39b4447a3ad96ca8d073144">tempest-AttachVolumeTestJSON-1589123637-project-member</nova:user>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:project uuid="7f0dc3e9a4bc447a80d5983bbafe3059">tempest-AttachVolumeTestJSON-1589123637</nova:project>
Nov 29 14:59:53 user nova-compute[75215]:       </nova:owner>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 14:59:53 user nova-compute[75215]:       <nova:ports>
Nov 29 14:59:53 user nova-compute[75215]:         <nova:port uuid="14ddadbd-807d-436c-b3a8-ca80400263e5">
Nov 29 14:59:53 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 14:59:53 user nova-compute[75215]:         </nova:port>
Nov 29 14:59:53 user nova-compute[75215]:       </nova:ports>
Nov 29 14:59:53 user nova-compute[75215]:     </nova:instance>
Nov 29 14:59:53 user nova-compute[75215]:   </metadata>
Nov 29 14:59:53 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 14:59:53 user nova-compute[75215]:     <system>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="serial">8ee90a2c-a7ec-443b-b913-33db128f07dc</entry>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="uuid">8ee90a2c-a7ec-443b-b913-33db128f07dc</entry>
Nov 29 14:59:53 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:59:53 user nova-compute[75215]:     </system>
Nov 29 14:59:53 user nova-compute[75215]:   </sysinfo>
Nov 29 14:59:53 user nova-compute[75215]:   <os>
Nov 29 14:59:53 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:59:53 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 14:59:53 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 14:59:53 user nova-compute[75215]:   </os>
Nov 29 14:59:53 user nova-compute[75215]:   <features>
Nov 29 14:59:53 user nova-compute[75215]:     <acpi/>
Nov 29 14:59:53 user nova-compute[75215]:     <apic/>
Nov 29 14:59:53 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 14:59:53 user nova-compute[75215]:   </features>
Nov 29 14:59:53 user nova-compute[75215]:   <clock offset="utc">
Nov 29 14:59:53 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:59:53 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:59:53 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 14:59:53 user nova-compute[75215]:   </clock>
Nov 29 14:59:53 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 14:59:53 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 14:59:53 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:59:53 user nova-compute[75215]:   </cpu>
Nov 29 14:59:53 user nova-compute[75215]:   <devices>
Nov 29 14:59:53 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 14:59:53 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:59:53 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk"/>
Nov 29 14:59:53 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 14:59:53 user nova-compute[75215]:     </disk>
Nov 29 14:59:53 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 14:59:53 user nova-compute[75215]:       <mac address="fa:16:3e:6f:dc:24"/>
Nov 29 14:59:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:59:53 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 14:59:53 user nova-compute[75215]:       <target dev="tap14ddadbd-80"/>
Nov 29 14:59:53 user nova-compute[75215]:     </interface>
Nov 29 14:59:53 user nova-compute[75215]:     <serial type="pty">
Nov 29 14:59:53 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/console.log" append="off"/>
Nov 29 14:59:53 user nova-compute[75215]:     </serial>
Nov 29 14:59:53 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:59:53 user nova-compute[75215]:     <video>
Nov 29 14:59:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 14:59:53 user nova-compute[75215]:     </video>
Nov 29 14:59:53 user nova-compute[75215]:     <rng model="virtio">
Nov 29 14:59:53 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:59:53 user nova-compute[75215]:     </rng>
Nov 29 14:59:53 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:59:53 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 14:59:53 user nova-compute[75215]:       <stats period="10"/>
Nov 29 14:59:53 user nova-compute[75215]:     </memballoon>
Nov 29 14:59:53 user nova-compute[75215]:   </devices>
Nov 29 14:59:53 user nova-compute[75215]: </domain>
Nov 29 14:59:53 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-568374541',display_name='tempest-AttachVolumeTestJSON-server-568374541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-568374541',id=33,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOfYdAeNFyFZILI1mRQVmBrtB0a1QbTXR4QSM3LWRIor6RFuIJeH2hqL3lpxOTx/4eqd6GGZsUPCvXbINY8jagQubh0xnYyu9fjBxaF3K6R9chMf4+C8RWbrbCiBg+kDQ==',key_name='tempest-keypair-397499663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-5ru00k1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=8ee90a2c-a7ec-443b-b913-33db128f07dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG os_vif [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fdb9860-b190-553e-9e01-49400a0bfbaa', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14ddadbd-80, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14ddadbd-80, col_values=(('qos', UUID('ad4aa8f5-2078-4039-8f5b-dda4950fa1d1')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14ddadbd-80, col_values=(('external_ids', {'iface-id': '14ddadbd-807d-436c-b3a8-ca80400263e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:dc:24', 'vm-uuid': '8ee90a2c-a7ec-443b-b913-33db128f07dc'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:53 user nova-compute[75215]: INFO os_vif [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80')
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:53 user nova-compute[75215]: WARNING nova.compute.manager [req-4694732c-af4a-445f-8ea7-dbc3f18af969 req-6987bd94-7864-4fe1-a617-deab21d6656b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state active and task_state None.
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No VIF found with MAC fa:16:3e:6f:dc:24, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updated VIF entry in instance network info cache for port 14ddadbd-807d-436c-b3a8-ca80400263e5. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating instance_info_cache with network_info: [{"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-53df5bcb-ca47-4ab0-9fe5-987bef4d5b2d req-5c0aa442-32d8-42f7-819b-fb2ca01bdded service nova] Releasing lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] No waiting events found dispatching network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:55 user nova-compute[75215]: WARNING nova.compute.manager [req-4d1d6305-a4d1-4df7-b5ac-e571e05087ee req-ce8f7a1b-70cb-4324-8fa6-d6f07932c011 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received unexpected event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 for instance with vm_state building and task_state spawning.
Nov 29 14:59:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] No waiting events found dispatching network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:59:57 user nova-compute[75215]: WARNING nova.compute.manager [req-76de4956-95b4-4a4b-84a5-e3095f41fcea req-721d318f-0511-4be3-8c67-5e7e77fa7c04 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received unexpected event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 for instance with vm_state building and task_state spawning.
Nov 29 14:59:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:59:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:59:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:59:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Instance spawned successfully.
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:59:59 user nova-compute[75215]: INFO nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Took 8.09 seconds to spawn the instance on the hypervisor.
Nov 29 14:59:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:59:59 user nova-compute[75215]: INFO nova.compute.manager [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Took 9.05 seconds to build instance.
Nov 29 14:59:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6548266d-cef3-4f26-b3b3-665f4f6ae6b8 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.179s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:59:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:00:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:00:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [{"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-a7d3b8e1-c2b3-4175-aef6-db44f969b212" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:00:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:00:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:00:07 user nova-compute[75215]: INFO nova.compute.manager [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] instance snapshotting
Nov 29 15:00:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Beginning live snapshot process
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66.delta 1073741824" returned: 0 in 0.062s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 15:00:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 15:00:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66.delta /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66.delta /opt/stack/data/nova/instances/snapshots/tmp_z5dmx4_/7c79f81570b049ad83813ca21181ad66" returned: 0 in 0.602s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Snapshot extracted, beginning image upload
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:00:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:00:12 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=23.809131622314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:00:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Snapshot image upload complete
Nov 29 15:00:12 user nova-compute[75215]: INFO nova.compute.manager [None req-5a99771a-38d1-496c-9517-fb7ed9c2ff2b tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Took 5.88 seconds to snapshot the instance on the hypervisor.
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a2453a5b-c323-445a-b680-5dad2690b08a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8ee90a2c-a7ec-443b-b913-33db128f07dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:00:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.154s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid d4c065a7-3c11-430a-b5dc-75869210d0a9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 6162fc1b-1263-475f-93ae-ed82d35b5c1e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:00:35 user nova-compute[75215]: INFO nova.compute.claims [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Claim successful on node user
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:00:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:00:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Creating image(s)
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "/opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "/opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "/opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG nova.policy [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a144c1faa35441158dbefe210c75e7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc1332b3ee44c5f9db4adb4c5f47ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk 1073741824" returned: 0 in 0.067s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Cannot resize image /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Ensure instance console log exists: /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Successfully created port: 7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Successfully updated port: 7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquired lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-changed-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Refreshing instance network info cache due to event network-changed-7ae0a60b-2957-4c40-bd81-5a0b9707f40a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] Acquiring lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating instance_info_cache with network_info: [{"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Releasing lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Instance network_info: |[{"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] Acquired lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Refreshing network info cache for port 7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Start _get_guest_xml network_info=[{"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:00:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:00:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1675757983',display_name='tempest-TestServerVolumeAttachmentScenario-server-1675757983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1675757983',id=34,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKePCh5BKAN7dI1bZDFa6l73IH/a7KOlNmmT5vPZmdhJZSGLywtQxhkt8Nlzxo7kn+P6AdG9h1ZQaOE64b3bkaJZHv/iwscQycyVlwz5vS9Gf+4L8+PRoACtARaoYPhShw==',key_name='tempest-keypair-1256072035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc1332b3ee44c5f9db4adb4c5f47ad6',ramdisk_id='',reservation_id='r-iv4mr8d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-462922840',owner_user_name='tempest-TestServerVolumeAttachmentScenario-462922840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a144c1faa35441158dbefe210c75e7a8',uuid=46d6a29d-1f74-42b8-b87d-655d72921a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converting VIF {"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'pci_devices' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:00:38 user nova-compute[75215]:   <uuid>46d6a29d-1f74-42b8-b87d-655d72921a16</uuid>
Nov 29 15:00:38 user nova-compute[75215]:   <name>instance-00000022</name>
Nov 29 15:00:38 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:00:38 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:00:38 user nova-compute[75215]:   <metadata>
Nov 29 15:00:38 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:00:38 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1675757983</nova:name>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:00:38</nova:creationTime>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:00:38 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:00:38 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:owner>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:user uuid="a144c1faa35441158dbefe210c75e7a8">tempest-TestServerVolumeAttachmentScenario-462922840-project-member</nova:user>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:project uuid="cbc1332b3ee44c5f9db4adb4c5f47ad6">tempest-TestServerVolumeAttachmentScenario-462922840</nova:project>
Nov 29 15:00:38 user nova-compute[75215]:       </nova:owner>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:00:38 user nova-compute[75215]:       <nova:ports>
Nov 29 15:00:38 user nova-compute[75215]:         <nova:port uuid="7ae0a60b-2957-4c40-bd81-5a0b9707f40a">
Nov 29 15:00:38 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 15:00:38 user nova-compute[75215]:         </nova:port>
Nov 29 15:00:38 user nova-compute[75215]:       </nova:ports>
Nov 29 15:00:38 user nova-compute[75215]:     </nova:instance>
Nov 29 15:00:38 user nova-compute[75215]:   </metadata>
Nov 29 15:00:38 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:00:38 user nova-compute[75215]:     <system>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="serial">46d6a29d-1f74-42b8-b87d-655d72921a16</entry>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="uuid">46d6a29d-1f74-42b8-b87d-655d72921a16</entry>
Nov 29 15:00:38 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:00:38 user nova-compute[75215]:     </system>
Nov 29 15:00:38 user nova-compute[75215]:   </sysinfo>
Nov 29 15:00:38 user nova-compute[75215]:   <os>
Nov 29 15:00:38 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:00:38 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:00:38 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:00:38 user nova-compute[75215]:   </os>
Nov 29 15:00:38 user nova-compute[75215]:   <features>
Nov 29 15:00:38 user nova-compute[75215]:     <acpi/>
Nov 29 15:00:38 user nova-compute[75215]:     <apic/>
Nov 29 15:00:38 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:00:38 user nova-compute[75215]:   </features>
Nov 29 15:00:38 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:00:38 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:00:38 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:00:38 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:00:38 user nova-compute[75215]:   </clock>
Nov 29 15:00:38 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:00:38 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:00:38 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:00:38 user nova-compute[75215]:   </cpu>
Nov 29 15:00:38 user nova-compute[75215]:   <devices>
Nov 29 15:00:38 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:00:38 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:00:38 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk"/>
Nov 29 15:00:38 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:00:38 user nova-compute[75215]:     </disk>
Nov 29 15:00:38 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:00:38 user nova-compute[75215]:       <mac address="fa:16:3e:b6:51:ef"/>
Nov 29 15:00:38 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:00:38 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:00:38 user nova-compute[75215]:       <target dev="tap7ae0a60b-29"/>
Nov 29 15:00:38 user nova-compute[75215]:     </interface>
Nov 29 15:00:38 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:00:38 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/console.log" append="off"/>
Nov 29 15:00:38 user nova-compute[75215]:     </serial>
Nov 29 15:00:38 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:00:38 user nova-compute[75215]:     <video>
Nov 29 15:00:38 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:00:38 user nova-compute[75215]:     </video>
Nov 29 15:00:38 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:00:38 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:00:38 user nova-compute[75215]:     </rng>
Nov 29 15:00:38 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:00:38 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:00:38 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:00:38 user nova-compute[75215]:     </memballoon>
Nov 29 15:00:38 user nova-compute[75215]:   </devices>
Nov 29 15:00:38 user nova-compute[75215]: </domain>
Nov 29 15:00:38 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1675757983',display_name='tempest-TestServerVolumeAttachmentScenario-server-1675757983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1675757983',id=34,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKePCh5BKAN7dI1bZDFa6l73IH/a7KOlNmmT5vPZmdhJZSGLywtQxhkt8Nlzxo7kn+P6AdG9h1ZQaOE64b3bkaJZHv/iwscQycyVlwz5vS9Gf+4L8+PRoACtARaoYPhShw==',key_name='tempest-keypair-1256072035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc1332b3ee44c5f9db4adb4c5f47ad6',ramdisk_id='',reservation_id='r-iv4mr8d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-462922840',owner_user_name='tempest-TestServerVolumeAttachmentScenario-462922840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a144c1faa35441158dbefe210c75e7a8',uuid=46d6a29d-1f74-42b8-b87d-655d72921a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converting VIF {"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG os_vif [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2664ff6f-de50-5b75-9530-ca0df882d22f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ae0a60b-29, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ae0a60b-29, col_values=(('qos', UUID('2c78018c-39a8-45a5-ab60-f4da53c32819')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ae0a60b-29, col_values=(('external_ids', {'iface-id': '7ae0a60b-2957-4c40-bd81-5a0b9707f40a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:51:ef', 'vm-uuid': '46d6a29d-1f74-42b8-b87d-655d72921a16'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:00:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:38 user nova-compute[75215]: INFO os_vif [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29')
Nov 29 15:00:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:00:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No VIF found with MAC fa:16:3e:b6:51:ef, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:00:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updated VIF entry in instance network info cache for port 7ae0a60b-2957-4c40-bd81-5a0b9707f40a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:00:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating instance_info_cache with network_info: [{"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-95bb8c1e-ee13-4ce7-b837-0a227080e8b9 req-f30f4d14-6532-4828-ae8f-868a2327c596 service nova] Releasing lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] No waiting events found dispatching network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:00:40 user nova-compute[75215]: WARNING nova.compute.manager [req-5fed00e0-bf80-473a-ac96-0402805a0731 req-5d006c22-a991-4744-8f2f-b448ef019099 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received unexpected event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a for instance with vm_state building and task_state spawning.
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:00:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Instance spawned successfully.
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:00:42 user nova-compute[75215]: INFO nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:00:42 user nova-compute[75215]: INFO nova.compute.manager [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Took 6.97 seconds to build instance.
Nov 29 15:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1376a5c-773a-49ad-8d56-1b66ca173b59 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.123s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] No waiting events found dispatching network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:00:42 user nova-compute[75215]: WARNING nova.compute.manager [req-9418df95-6753-4808-8daf-4d11118d40c3 req-28161fa5-1286-4439-a7eb-b7e02f95f8f0 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received unexpected event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a for instance with vm_state active and task_state None.
Nov 29 15:00:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-changed-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:00:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Refreshing instance network info cache due to event network-changed-19d9b82b-929a-41bb-be01-f10b8d947277. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:00:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] Acquiring lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] Acquired lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Refreshing network info cache for port 19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:00:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updated VIF entry in instance network info cache for port 19d9b82b-929a-41bb-be01-f10b8d947277. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:00:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updating instance_info_cache with network_info: [{"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-12a163bb-5110-46cb-aa41-88e4ac34efd1 req-504368b2-d9ab-404a-8252-5e8c8eb088dc service nova] Releasing lock "refresh_cache-a2453a5b-c323-445a-b680-5dad2690b08a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG nova.objects.instance [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:53 user nova-compute[75215]: INFO nova.compute.manager [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Attaching volume 3a617f5e-1442-4fb1-854d-00aa75be96cd to /dev/vdb
Nov 29 15:00:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caad8c3-704d-47ec-b128-9194c0261e30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d421f1-7d27-45d9-8bd0-b4b6ec853aee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1fc949-6992-44ab-af2a-f39bb2586049]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c967f7-3d15-4786-8e10-5d6c83b217fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:00:53 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:00:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e26a8d-5fb0-4465-ade9-80f95218f006]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updating existing volume attachment record: 55932ef3-3035-403c-b98b-4f5765159d5d {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:00:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:00:55 user nova-compute[75215]: INFO nova.compute.claims [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Claim successful on node user
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:00:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG nova.policy [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25bf6c00d9b340c78b2e136f22b2b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9445b58a3554c19b57afbffbaa6a112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:00:55 user nova-compute[75215]: INFO nova.virt.block_device [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Booting with volume 6eba59e4-0f5e-4f4e-91e9-0b6e705f779a at /dev/vda
Nov 29 15:00:55 user nova-compute[75215]: DEBUG os_brick.utils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf4349-5eb9-435e-a4a0-4105dbc635b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[518202d0-0cc8-468f-863a-2add92880d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a55d2-544d-41f6-9ea4-130ad677389c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6602ff1f-7a22-4ca3-8c8e-a1603fac7f8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:00:56 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:00:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe2f78-64e2-49db-9da8-2f1b3c3f8379]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG os_brick.utils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating existing volume attachment record: c0e7cac3-959d-4647-b0bc-4bc037755423 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:00:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Successfully created port: 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Successfully updated port: 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-changed-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Refreshing instance network info cache due to event network-changed-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance network_info: |[{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:00:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Refreshing network info cache for port 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updated VIF entry in instance network info cache for port 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcd9a339-2991-4c17-a101-b735a743df27 req-33704279-22d6-4e14-8ab0-f0be2025eb10 service nova] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:00:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [{"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8941f1e0-c109-43be-a997-fedcfd1c8e99" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:01:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjSzaPBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:01 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4343d30-8ea3-4656-a1b4-e7c9258df6e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:01:01 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02367b67-93d8-4edc-a303-de63eb683a1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd] added
Nov 29 15:01:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1319e77-e119-4143-b199-fecf05655991]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2d6aa-c51a-4152-9f0f-3975d003fe8e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjSzaPBc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjSzaPBc" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ef70a-6ac6-43b6-8bd1-1b81f2e2e351]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjSzaPBc'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41216fe5-7710-4ecd-8683-298d6c468545]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823a8c7-0032-45c5-9fb9-3d76f56d9f80]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2d1ed-6a02-4cc5-922b-834bcb4b6867]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260]
Nov 29 15:01:02 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260] successful.
Nov 29 15:01:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[864591fa-301f-4e5d-b5ca-418eb8cf80c1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfa64a3-7361-4bc5-aa30-a1093630188b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:02 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adb9bf-0b05-4562-a5db-56cf7e717cf8]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjSzaPBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26563623030396332', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563623030396332', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:01:03 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:03 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:01:03 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:03 user nova-compute[75215]:   <serial>3a617f5e-1442-4fb1-854d-00aa75be96cd</serial>
Nov 29 15:01:03 user nova-compute[75215]: </disk>
Nov 29 15:01:03 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] No VIF found with MAC fa:16:3e:18:79:87, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:01:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Creating image(s)
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Ensure instance console log exists: /opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start _get_guest_xml network_info=[{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c0e7cac3-959d-4647-b0bc-4bc037755423', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84a68868-1bdd-46a7-b821-ee205f6e1c38', 'attached_at': '', 'detached_at': '', 'volume_id': '6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'serial': '6eba59e4-0f5e-4f4e-91e9-0b6e705f779a'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a721f-8d1e-4b52-95f3-895e55968875 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.177s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:03 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbbd03c-1774-45a2-b0e7-ac7200fa1daf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:01:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c956fda1-04f5-4876-aca0-9338a6d54fee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a] added
Nov 29 15:01:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c1fadb-c430-4c6e-a92f-6cf4b9a8cb99]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7f4e8-e925-474e-a425-cad218f75b3d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKjRWzPu {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKjRWzPu" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f677ac-ccc4-41e7-b569-a85863696d82]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKjRWzPu'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d1549-aea1-48af-9f0e-f35ec0ef942a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[40837b0f-74e2-428c-b65c-d823a78bb145]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6c7b70-fc6c-487e-8c50-6b9197f640fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]
Nov 29 15:01:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.
Nov 29 15:01:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866a5fa-baa7-4759-9756-d63666933b90]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60e5e7-2acb-4304-b8fc-e94a49902bbe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:04 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd300cec-d307-4f34-9bb5-b00fa129c813]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:04 user nova-compute[75215]: INFO nova.compute.manager [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Detaching volume 3a617f5e-1442-4fb1-854d-00aa75be96cd
Nov 29 15:01:04 user nova-compute[75215]: INFO nova.virt.block_device [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Attempting to driver detach volume 3a617f5e-1442-4fb1-854d-00aa75be96cd from mountpoint /dev/vdb
Nov 29 15:01:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Attempting to detach device vdb from instance a2453a5b-c323-445a-b680-5dad2690b08a from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:01:04 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:04 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:01:04 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:04 user nova-compute[75215]:   <serial>3a617f5e-1442-4fb1-854d-00aa75be96cd</serial>
Nov 29 15:01:04 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:01:04 user nova-compute[75215]: </disk>
Nov 29 15:01:04 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:01:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance a2453a5b-c323-445a-b680-5dad2690b08a from the persistent domain config.
Nov 29 15:01:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2453a5b-c323-445a-b680-5dad2690b08a from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:01:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:01:04 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:04 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:01:04 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:04 user nova-compute[75215]:   <serial>3a617f5e-1442-4fb1-854d-00aa75be96cd</serial>
Nov 29 15:01:04 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:01:04 user nova-compute[75215]: </disk>
Nov 29 15:01:04 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23930623338366431', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930623338366431', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'pci_devices' on Instance uuid 84a68868-1bdd-46a7-b821-ee205f6e1c38 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:01:05 user nova-compute[75215]:   <uuid>84a68868-1bdd-46a7-b821-ee205f6e1c38</uuid>
Nov 29 15:01:05 user nova-compute[75215]:   <name>instance-00000023</name>
Nov 29 15:01:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:01:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:01:05 user nova-compute[75215]:   <metadata>
Nov 29 15:01:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:01:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:01:05 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-1093913007</nova:name>
Nov 29 15:01:05 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:01:03</nova:creationTime>
Nov 29 15:01:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:01:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:01:05 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:01:05 user nova-compute[75215]:       <nova:owner>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:user uuid="25bf6c00d9b340c78b2e136f22b2b211">tempest-ServerActionsTestOtherA-380950315-project-member</nova:user>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:project uuid="f9445b58a3554c19b57afbffbaa6a112">tempest-ServerActionsTestOtherA-380950315</nova:project>
Nov 29 15:01:05 user nova-compute[75215]:       </nova:owner>
Nov 29 15:01:05 user nova-compute[75215]:       <nova:ports>
Nov 29 15:01:05 user nova-compute[75215]:         <nova:port uuid="8c82e40f-912f-4ec7-a5b8-7ceb93c3367d">
Nov 29 15:01:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 15:01:05 user nova-compute[75215]:         </nova:port>
Nov 29 15:01:05 user nova-compute[75215]:       </nova:ports>
Nov 29 15:01:05 user nova-compute[75215]:     </nova:instance>
Nov 29 15:01:05 user nova-compute[75215]:   </metadata>
Nov 29 15:01:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:01:05 user nova-compute[75215]:     <system>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="serial">84a68868-1bdd-46a7-b821-ee205f6e1c38</entry>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="uuid">84a68868-1bdd-46a7-b821-ee205f6e1c38</entry>
Nov 29 15:01:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:01:05 user nova-compute[75215]:     </system>
Nov 29 15:01:05 user nova-compute[75215]:   </sysinfo>
Nov 29 15:01:05 user nova-compute[75215]:   <os>
Nov 29 15:01:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:01:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:01:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:01:05 user nova-compute[75215]:   </os>
Nov 29 15:01:05 user nova-compute[75215]:   <features>
Nov 29 15:01:05 user nova-compute[75215]:     <acpi/>
Nov 29 15:01:05 user nova-compute[75215]:     <apic/>
Nov 29 15:01:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:01:05 user nova-compute[75215]:   </features>
Nov 29 15:01:05 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:01:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:01:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:01:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:01:05 user nova-compute[75215]:   </clock>
Nov 29 15:01:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:01:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:01:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:01:05 user nova-compute[75215]:   </cpu>
Nov 29 15:01:05 user nova-compute[75215]:   <devices>
Nov 29 15:01:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:01:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:05 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 15:01:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:01:05 user nova-compute[75215]:       <serial>6eba59e4-0f5e-4f4e-91e9-0b6e705f779a</serial>
Nov 29 15:01:05 user nova-compute[75215]:     </disk>
Nov 29 15:01:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:01:05 user nova-compute[75215]:       <mac address="fa:16:3e:60:4f:e9"/>
Nov 29 15:01:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:01:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:01:05 user nova-compute[75215]:       <target dev="tap8c82e40f-91"/>
Nov 29 15:01:05 user nova-compute[75215]:     </interface>
Nov 29 15:01:05 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:01:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38/console.log" append="off"/>
Nov 29 15:01:05 user nova-compute[75215]:     </serial>
Nov 29 15:01:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:01:05 user nova-compute[75215]:     <video>
Nov 29 15:01:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:01:05 user nova-compute[75215]:     </video>
Nov 29 15:01:05 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:01:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:01:05 user nova-compute[75215]:     </rng>
Nov 29 15:01:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:01:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:01:05 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:01:05 user nova-compute[75215]:     </memballoon>
Nov 29 15:01:05 user nova-compute[75215]:   </devices>
Nov 29 15:01:05 user nova-compute[75215]: </domain>
Nov 29 15:01:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG os_vif [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a991e8cb-6a45-5e00-88c9-e8383b637390', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c82e40f-91, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c82e40f-91, col_values=(('qos', UUID('703faae5-6871-43d3-9dfb-24d4fc11e26d')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c82e40f-91, col_values=(('external_ids', {'iface-id': '8c82e40f-912f-4ec7-a5b8-7ceb93c3367d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:4f:e9', 'vm-uuid': '84a68868-1bdd-46a7-b821-ee205f6e1c38'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:05 user nova-compute[75215]: INFO os_vif [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91')
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:60:4f:e9, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:06 user nova-compute[75215]: WARNING nova.compute.manager [req-bc4b65aa-bb7e-45e6-b73e-d845fd84ece4 req-8d9f2dc5-b5f2-4a24-a635-6de270843082 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state building and task_state spawning.
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance spawned successfully.
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:08 user nova-compute[75215]: WARNING nova.compute.manager [req-2d514bb9-7bdf-4c1c-8145-0cb482848a55 req-7c4474e2-a077-4bf6-974c-b7e3721430a2 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state building and task_state spawning.
Nov 29 15:01:08 user nova-compute[75215]: INFO nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:08 user nova-compute[75215]: INFO nova.compute.manager [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Took 13.84 seconds to build instance.
Nov 29 15:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0280396d-1438-4289-a8f5-cfeb4cf5d1c4 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.945s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7836MB free_disk=24.690990447998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a2453a5b-c323-445a-b680-5dad2690b08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8ee90a2c-a7ec-443b-b913-33db128f07dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 46d6a29d-1f74-42b8-b87d-655d72921a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:01:15 user nova-compute[75215]: INFO nova.compute.claims [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Claim successful on node user
Nov 29 15:01:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:01:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:01:15 user nova-compute[75215]: DEBUG nova.policy [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fad9c93f4ea491880e3cd7a97518367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72c331f6f384976bc971f9318b7d0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:01:15 user nova-compute[75215]: INFO nova.virt.block_device [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Booting with volume-backed-image e99e1aa5-1b15-43b4-b195-011929ff5a30 at /dev/vda
Nov 29 15:01:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Successfully created port: 62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Successfully updated port: 62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-changed-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Refreshing instance network info cache due to event network-changed-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] Acquiring lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating instance_info_cache with network_info: [{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance network_info: |[{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] Acquired lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Refreshing network info cache for port 62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updated VIF entry in instance network info cache for port 62f4d3fc-9d76-4181-9c32-ca7a09fbeb73. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating instance_info_cache with network_info: [{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2a39432-f206-4d8e-812c-e8ef865f6f4a req-7d2fcfc5-8318-404f-a1e4-601be033bc92 service nova] Releasing lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.utils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[37205d4d-815a-48b3-be73-758a3cd809b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76526f2e-7b10-4305-811d-c689368203e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac5e56-752c-487f-8b6c-9330e9159826]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfadbea-e479-4f28-826b-c8589c3a63e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:21 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:01:21 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279190b-071a-4c48-ab13-60ec8df2da04]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG os_brick.utils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:21 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating existing volume attachment record: de825bc7-7886-4853-8953-15f61c9fb9ac {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:01:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2453a5b-c323-445a-b680-5dad2690b08a is timed out.
Nov 29 15:01:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully detached device vdb from instance a2453a5b-c323-445a-b680-5dad2690b08a from the live domain config.
Nov 29 15:01:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjSzaPBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:25 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[145689ac-72c1-4a01-b18d-2c1c24b14324]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:01:25 user nova-compute[75215]: No targets found.
Nov 29 15:01:25 user nova-compute[75215]: iSNS:
Nov 29 15:01:25 user nova-compute[75215]: No targets found.
Nov 29 15:01:25 user nova-compute[75215]: STATIC:
Nov 29 15:01:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:01:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:01:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:01:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd
Nov 29 15:01:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:01:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:01:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086
Nov 29 15:01:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:01:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:01:25 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:01:25 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:01:25 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:01:25 user nova-compute[75215]: FIRMWARE:
Nov 29 15:01:25 user nova-compute[75215]: No targets found.
Nov 29 15:01:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:01:25 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:01:25 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdcc89c-353e-465d-9717-c1538aa55a88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f34616-45e5-41b6-b74b-30dfccfca148]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd (non-flash)
Nov 29 15:01:25 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885badd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d2a7d-7d7b-4d30-ab3e-0fab7b2699b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dc223c-3868-42d2-aba4-7e1056e44b9e]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da6f8f-8762-4d45-ba21-4a50eeda05ef]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a54e231-eb17-4854-bb39-f83875d7ed67]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b04ee9f-84fe-4a95-a258-6e721518dc70]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.160s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2650914-810c-4d84-8ce0-873c3f1e0b2e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260]
Nov 29 15:01:25 user nova-compute[75215]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd, portal: 172.16.0.220,3260] successful.
Nov 29 15:01:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a617f5e-1442-4fb1-854d-00aa75be96cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218d3bf-01bc-4deb-8f3e-f77152b20992]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] <== disconnect_volume: return (404ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:01:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'flavor' on Instance uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a06d9bbf-548d-429c-b890-9585874579b3 tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:01:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Creating image(s)
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Ensure instance console log exists: /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start _get_guest_xml network_info=[{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'de825bc7-7886-4853-8953-15f61c9fb9ac', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4a39cd7-cd54-49f6-8e92-a272fc3f043a', 'attached_at': '', 'detached_at': '', 'volume_id': '39033451-8732-4cbb-8410-d06b9a60e79e', 'serial': '39033451-8732-4cbb-8410-d06b9a60e79e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:01:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:29 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc55407-75fd-4384-884c-7f0e7b22b198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:01:29 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4146dec2-86b0-47b5-a48f-c1974a977ed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e] added
Nov 29 15:01:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.266s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cfa243-8cae-4e8e-ab6e-3d729f1ea35f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbe203e-c2c4-4312-b641-9ea269500a29]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQVFGUas {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQVFGUas" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f353ac6-1290-4c7b-a166-be71bd9c8139]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQVFGUas'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609d0b7-8885-4113-aef7-6a3cee6a294b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb723a-8178-41b6-befd-a6177f54ff04]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:29 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:29 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:29 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:29 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34635fa-753d-4ce4-a8c6-d4f1917436c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260]
Nov 29 15:01:30 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260] successful.
Nov 29 15:01:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee5eb8f-c181-4994-a581-e704e364abe0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc88be4-4928-48fb-805e-f05fab967606]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:30 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.543s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f1e5a-6690-4477-88a1-9c47de68bfe9]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:01:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '23563343932356233', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563343932356233', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145400785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145400785',id=36,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-4zazwqw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:01:16Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=e4a39cd7-cd54-49f6-8e92-a272fc3f043a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:01:31 user nova-compute[75215]:   <uuid>e4a39cd7-cd54-49f6-8e92-a272fc3f043a</uuid>
Nov 29 15:01:31 user nova-compute[75215]:   <name>instance-00000024</name>
Nov 29 15:01:31 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:01:31 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:01:31 user nova-compute[75215]:   <metadata>
Nov 29 15:01:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:01:31 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2145400785</nova:name>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:01:29</nova:creationTime>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:01:31 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:01:31 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:owner>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 15:01:31 user nova-compute[75215]:       </nova:owner>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:01:31 user nova-compute[75215]:       <nova:ports>
Nov 29 15:01:31 user nova-compute[75215]:         <nova:port uuid="62f4d3fc-9d76-4181-9c32-ca7a09fbeb73">
Nov 29 15:01:31 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 15:01:31 user nova-compute[75215]:         </nova:port>
Nov 29 15:01:31 user nova-compute[75215]:       </nova:ports>
Nov 29 15:01:31 user nova-compute[75215]:     </nova:instance>
Nov 29 15:01:31 user nova-compute[75215]:   </metadata>
Nov 29 15:01:31 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:01:31 user nova-compute[75215]:     <system>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="serial">e4a39cd7-cd54-49f6-8e92-a272fc3f043a</entry>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="uuid">e4a39cd7-cd54-49f6-8e92-a272fc3f043a</entry>
Nov 29 15:01:31 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:01:31 user nova-compute[75215]:     </system>
Nov 29 15:01:31 user nova-compute[75215]:   </sysinfo>
Nov 29 15:01:31 user nova-compute[75215]:   <os>
Nov 29 15:01:31 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:01:31 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:01:31 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:01:31 user nova-compute[75215]:   </os>
Nov 29 15:01:31 user nova-compute[75215]:   <features>
Nov 29 15:01:31 user nova-compute[75215]:     <acpi/>
Nov 29 15:01:31 user nova-compute[75215]:     <apic/>
Nov 29 15:01:31 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:01:31 user nova-compute[75215]:   </features>
Nov 29 15:01:31 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:01:31 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:01:31 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:01:31 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:01:31 user nova-compute[75215]:   </clock>
Nov 29 15:01:31 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:01:31 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:01:31 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:01:31 user nova-compute[75215]:   </cpu>
Nov 29 15:01:31 user nova-compute[75215]:   <devices>
Nov 29 15:01:31 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:01:31 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:31 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:01:31 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:01:31 user nova-compute[75215]:       <serial>39033451-8732-4cbb-8410-d06b9a60e79e</serial>
Nov 29 15:01:31 user nova-compute[75215]:     </disk>
Nov 29 15:01:31 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:01:31 user nova-compute[75215]:       <mac address="fa:16:3e:a9:23:09"/>
Nov 29 15:01:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:01:31 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:01:31 user nova-compute[75215]:       <target dev="tap62f4d3fc-9d"/>
Nov 29 15:01:31 user nova-compute[75215]:     </interface>
Nov 29 15:01:31 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:01:31 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/console.log" append="off"/>
Nov 29 15:01:31 user nova-compute[75215]:     </serial>
Nov 29 15:01:31 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:01:31 user nova-compute[75215]:     <video>
Nov 29 15:01:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:01:31 user nova-compute[75215]:     </video>
Nov 29 15:01:31 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:01:31 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:01:31 user nova-compute[75215]:     </rng>
Nov 29 15:01:31 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:01:31 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:01:31 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:01:31 user nova-compute[75215]:     </memballoon>
Nov 29 15:01:31 user nova-compute[75215]:   </devices>
Nov 29 15:01:31 user nova-compute[75215]: </domain>
Nov 29 15:01:31 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145400785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145400785',id=36,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-4zazwqw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:01:16Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=e4a39cd7-cd54-49f6-8e92-a272fc3f043a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG os_vif [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8463b89d-c391-5861-8367-1b92848415ae', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62f4d3fc-9d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62f4d3fc-9d, col_values=(('qos', UUID('9580d8f9-4723-48c2-9a4f-90cd21f6da32')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62f4d3fc-9d, col_values=(('external_ids', {'iface-id': '62f4d3fc-9d76-4181-9c32-ca7a09fbeb73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:23:09', 'vm-uuid': 'e4a39cd7-cd54-49f6-8e92-a272fc3f043a'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:31 user nova-compute[75215]: INFO os_vif [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d')
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:a9:23:09, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:32 user nova-compute[75215]: WARNING nova.compute.manager [req-82fec6b7-4f3e-490d-807c-a54c0943f17a req-fc07a440-518b-4e8a-b887-da08c479be05 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state building and task_state spawning.
Nov 29 15:01:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:01:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance spawned successfully.
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:01:34 user nova-compute[75215]: INFO nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:01:34 user nova-compute[75215]: INFO nova.compute.manager [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Took 19.76 seconds to build instance.
Nov 29 15:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-da00933d-0979-47b9-9044-da46a2deadd3 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.853s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:34 user nova-compute[75215]: WARNING nova.compute.manager [req-90f11a1b-1662-4867-a9d7-38c2f3cc2cda req-afaff5c3-a953-4f06-b9b0-5b595dd86054 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state None.
Nov 29 15:01:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing instance network info cache due to event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:40 user nova-compute[75215]: INFO nova.compute.manager [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Detaching volume d313a033-3a62-4649-911d-51e08c1a1086
Nov 29 15:01:40 user nova-compute[75215]: INFO nova.virt.block_device [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Attempting to driver detach volume d313a033-3a62-4649-911d-51e08c1a1086 from mountpoint /dev/vdb
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Attempting to detach device vdb from instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:01:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:40 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 15:01:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:40 user nova-compute[75215]:   <serial>d313a033-3a62-4649-911d-51e08c1a1086</serial>
Nov 29 15:01:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:01:40 user nova-compute[75215]: </disk>
Nov 29 15:01:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:01:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully detached device vdb from instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab from the persistent domain config.
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:01:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:40 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 15:01:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:40 user nova-compute[75215]:   <serial>d313a033-3a62-4649-911d-51e08c1a1086</serial>
Nov 29 15:01:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:01:40 user nova-compute[75215]: </disk>
Nov 29 15:01:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updated VIF entry in instance network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2eeb02a1-0033-4e81-87ee-7084a5f427a3 req-e57f806d-0091-4f67-9238-9edc34e30cd4 service nova] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:01:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing instance network info cache due to event network-changed-98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Acquiring lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Acquired lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Refreshing network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updated VIF entry in instance network info cache for port 98c955ff-b257-4fd5-98d0-c75d3b63287f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [{"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Releasing lock "refresh_cache-9ced07bb-dd04-4b80-98ee-64afe84ea0ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-changed-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Refreshing instance network info cache due to event network-changed-14ddadbd-807d-436c-b3a8-ca80400263e5. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Acquiring lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Acquired lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Refreshing network info cache for port 14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updated VIF entry in instance network info cache for port 14ddadbd-807d-436c-b3a8-ca80400263e5. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating instance_info_cache with network_info: [{"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1415328-71a0-425b-b27c-e7b47b27f08e req-0537ce73-4d6e-45cc-8caf-9e8c78a281a8 service nova] Releasing lock "refresh_cache-8ee90a2c-a7ec-443b-b913-33db128f07dc" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:01:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:45 user nova-compute[75215]: INFO nova.compute.manager [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attaching volume a35892fd-7bb3-405b-92ec-cfa4ace47941 to /dev/vdb
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd3dbf-d45a-4fcb-a296-1ac2ea20f1ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a772dd1-64fd-4312-97ac-0c2671ed7d1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855cd58-1c36-4996-a212-feedfd8be0c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d817d-eff7-4156-ac0a-4552969df19f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:45 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:01:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783eabb-2fb9-46a5-8174-2ba51d042d8f]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:45 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating existing volume attachment record: 06b5721c-c56f-48d1-a4f7-9be033a5487c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:01:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNyprAno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:01:53 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[79489eb6-6d83-4506-a746-7619e4e53f3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:01:53 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f77a0b-489d-4552-969a-0723994b51d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941] added
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc527188-577d-4f39-b337-012b2d70f657]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f74f31-7aed-4d9c-89cc-7b99259ab16d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNyprAno {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNyprAno" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[25455a3d-1b96-4a48-a9d0-dc6dbf7eb733]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FNyprAno'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f5ea90-2fa3-40da-a32a-235304be4bf8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe33eb-7ac0-42e1-bc30-acb2cf7974eb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f01f07-cc0f-48a7-8c15-df3511b3bf31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260]
Nov 29 15:01:53 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260] successful.
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cca391-9abc-4e65-a1d9-a41a97f3b0be]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef8a97e-dee2-497a-a37c-9003fc294d4e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:01:53 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:01:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41102d5-fcea-405a-8af9-938dad19d47b]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNyprAno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:01:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23266663464323065', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266663464323065', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:01:54 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:01:54 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:01:54 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:01:54 user nova-compute[75215]:   <serial>a35892fd-7bb3-405b-92ec-cfa4ace47941</serial>
Nov 29 15:01:54 user nova-compute[75215]: </disk>
Nov 29 15:01:54 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:01:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No VIF found with MAC fa:16:3e:6f:dc:24, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:55 user nova-compute[75215]: INFO nova.compute.manager [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Terminating instance
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37ed440f-82dd-4ed9-ad81-d86b7b44dc90 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.027s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-unplugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] No waiting events found dispatching network-vif-unplugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e423e01-e553-43b2-a4d6-4385ff399d17 req-df92e362-512e-4526-9ada-054cd42f6268 service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-unplugged-19d9b82b-929a-41bb-be01-f10b8d947277 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:01:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Instance destroyed successfully.
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lazy-loading 'resources' on Instance uuid a2453a5b-c323-445a-b680-5dad2690b08a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-147484494',display_name='tempest-AttachVolumeNegativeTest-server-147484494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-147484494',id=32,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNKmhx7wcuUGYWnf5t+i9E2DD2qc4qGewMQrTKWtX9sBS1GdDbZrnVAFynsSK3Ykri2lRVJNAqwo9xHjTiMfLaVx80Md9u8Df1asxdp6Hw+w5R3PMuh3asMpMidQhDRTw==',key_name='tempest-keypair-1179512799',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35e6a6477d6b4664a2f0de1b0bdc15e2',ramdisk_id='',reservation_id='r-7hv8b45w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1682890616',owner_user_name='tempest-AttachVolumeNegativeTest-1682890616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d88477198b5d411f9e193afdb9f40e03',uuid=a2453a5b-c323-445a-b680-5dad2690b08a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converting VIF {"id": "19d9b82b-929a-41bb-be01-f10b8d947277", "address": "fa:16:3e:18:79:87", "network": {"id": "a22e7c51-fc6f-44f5-8635-b92c579043b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1149554516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e6a6477d6b4664a2f0de1b0bdc15e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d9b82b-92", "ovs_interfaceid": "19d9b82b-929a-41bb-be01-f10b8d947277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG os_vif [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19d9b82b-92, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f801e12b-76fa-4079-8573-be6c843b0ef3) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:01:55 user nova-compute[75215]: INFO os_vif [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:79:87,bridge_name='br-int',has_traffic_filtering=True,id=19d9b82b-929a-41bb-be01-f10b8d947277,network=Network(a22e7c51-fc6f-44f5-8635-b92c579043b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d9b82b-92')
Nov 29 15:01:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Deleting instance files /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a_del
Nov 29 15:01:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Deletion of /opt/stack/data/nova/instances/a2453a5b-c323-445a-b680-5dad2690b08a_del complete
Nov 29 15:01:55 user nova-compute[75215]: INFO nova.compute.manager [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 15:01:55 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:01:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:01:57 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Took 1.38 seconds to deallocate network for instance.
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] Acquiring lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] Lock "a2453a5b-c323-445a-b680-5dad2690b08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] No waiting events found dispatching network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:01:57 user nova-compute[75215]: WARNING nova.compute.manager [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received unexpected event network-vif-plugged-19d9b82b-929a-41bb-be01-f10b8d947277 for instance with vm_state deleted and task_state None.
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e3b7222-231c-4246-a378-6aa0c8d6fe21 req-3c37aa3e-1077-4bb6-8005-d32c9dffda3c service nova] [instance: a2453a5b-c323-445a-b680-5dad2690b08a] Received event network-vif-deleted-19d9b82b-929a-41bb-be01-f10b8d947277 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:57 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Deleted allocations for instance a2453a5b-c323-445a-b680-5dad2690b08a
Nov 29 15:01:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c6dc30f-fb68-42f7-84fb-37d9e9ea793b tempest-AttachVolumeNegativeTest-1682890616 tempest-AttachVolumeNegativeTest-1682890616-project-member] Lock "a2453a5b-c323-445a-b680-5dad2690b08a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:01:59 user nova-compute[75215]: INFO nova.compute.manager [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attaching volume e032e10a-eda4-410e-b071-cc2ec5b2191a to /dev/vdc
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cf0caa-ecca-42f6-b34f-312225af5b66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b654014-c2a9-46fc-9b57-37c2edf1e437]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4b60a-1246-42a1-bcdf-b1fd182105da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c101d1-131e-4b25-9d95-7c9dbf59520c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:01:59 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:01:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b941bad-1008-40ed-8270-b75ea40b9ee4]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:01:59 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating existing volume attachment record: 224c73ff-66f7-4784-bce8-510b0a612856 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab is timed out.
Nov 29 15:02:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully detached device vdb from instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab from the live domain config.
Nov 29 15:02:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUtCfoQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef847cd5-fc42-4cb9-8b6e-34a8f81348c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:02:00 user nova-compute[75215]: No targets found.
Nov 29 15:02:00 user nova-compute[75215]: iSNS:
Nov 29 15:02:00 user nova-compute[75215]: No targets found.
Nov 29 15:02:00 user nova-compute[75215]: STATIC:
Nov 29 15:02:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:02:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941
Nov 29 15:02:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086
Nov 29 15:02:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:02:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:02:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:00 user nova-compute[75215]: FIRMWARE:
Nov 29 15:02:00 user nova-compute[75215]: No targets found.
Nov 29 15:02:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:02:00 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:02:00 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6233fae-3485-4548-8831-4f8151c33868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9ed0e6-6ee6-4152-b95c-691572ef64f2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:00 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885bb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:02:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4b267-36e0-4568-a57f-b1304cd5af96]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e93869-8eaf-47b4-99f7-0cf5fc96a977]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deab629-1084-4659-992c-9772dc3ed59a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13eb6e0-126a-4cef-94f4-b99093bc73f5]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0efcfc2-5a65-44e2-bc9a-2e3f4f2108e5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b72d0f-c1a2-497b-91e8-13f3a7508dcc]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260]
Nov 29 15:02:01 user nova-compute[75215]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d313a033-3a62-4649-911d-51e08c1a1086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29195ec0-79dc-44e4-b8bb-e015205129fe]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] <== disconnect_volume: return (338ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'flavor' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-548b7042-8390-4ea3-ba14-7dcd06eed705 tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:02:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXqvmSGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:06 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:06 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:06 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15302b01-8a36-430d-b1c4-3f11021fd577]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:02:06 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c75f9b-abde-4f5b-a191-b933e8715769]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a] added
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47650e6-1842-4ea3-bff6-6fc6dd1e3ffa]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[945198b2-2f6a-41ca-ae23-40ff530f94e9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXqvmSGg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXqvmSGg" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4fdf9-79e4-4c54-85c8-bf927223d63e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXqvmSGg'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca636140-b2a1-46fc-9a30-345aef944133]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20d1557-3be3-4bf0-afd0-464b0a11a4a3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0987b234-ad85-4f03-b4b8-0e745c2472b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260]
Nov 29 15:02:06 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[873675fe-b35b-4f23-b84b-4db73cdf9d9b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ffdf0-35ef-4b8a-840a-0df9510c1864]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:06 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:07 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce2937-42bf-487d-b71c-9a2b43a4e0f4]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:07 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:02:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXqvmSGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23933393531646431', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933393531646431', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:02:08 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:08 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 15:02:08 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:08 user nova-compute[75215]:   <serial>e032e10a-eda4-410e-b071-cc2ec5b2191a</serial>
Nov 29 15:02:08 user nova-compute[75215]: </disk>
Nov 29 15:02:08 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] No VIF found with MAC fa:16:3e:6f:dc:24, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-85d5dc57-cad5-420b-8d22-2b843feac2c6 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.762s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:02:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:10 user nova-compute[75215]: INFO nova.compute.manager [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Detaching volume a35892fd-7bb3-405b-92ec-cfa4ace47941
Nov 29 15:02:10 user nova-compute[75215]: INFO nova.virt.block_device [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attempting to driver detach volume a35892fd-7bb3-405b-92ec-cfa4ace47941 from mountpoint /dev/vdb
Nov 29 15:02:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Attempting to detach device vdb from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:10 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:10 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:02:10 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:02:10 user nova-compute[75215]:   <serial>a35892fd-7bb3-405b-92ec-cfa4ace47941</serial>
Nov 29 15:02:10 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:02:10 user nova-compute[75215]: </disk>
Nov 29 15:02:10 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdb from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the persistent domain config.
Nov 29 15:02:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:10 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:10 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:02:10 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:02:10 user nova-compute[75215]:   <serial>a35892fd-7bb3-405b-92ec-cfa4ace47941</serial>
Nov 29 15:02:10 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:02:10 user nova-compute[75215]: </disk>
Nov 29 15:02:10 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:02:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=24.715545654296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8ee90a2c-a7ec-443b-b913-33db128f07dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 46d6a29d-1f74-42b8-b87d-655d72921a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:02:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:02:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-changed-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Refreshing instance network info cache due to event network-changed-7ae0a60b-2957-4c40-bd81-5a0b9707f40a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:02:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] Acquiring lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] Acquired lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Refreshing network info cache for port 7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updated VIF entry in instance network info cache for port 7ae0a60b-2957-4c40-bd81-5a0b9707f40a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating instance_info_cache with network_info: [{"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fabed466-22b6-47bc-b1d2-81f1530d3502 req-3b8831af-c666-4000-a1c9-7a928002a5ca service nova] Releasing lock "refresh_cache-46d6a29d-1f74-42b8-b87d-655d72921a16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:27 user nova-compute[75215]: INFO nova.compute.manager [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attaching volume 25cc3808-e6c1-4f54-b3a2-215699be4b5d to /dev/vdb
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f110692-dc59-415c-bc9d-37f6159bb29a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf14a529-7025-4284-99e5-2ac03bed30e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ef313-0e22-4e0d-993d-d1ad8d9f6dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08dc67-28d5-49ce-9d61-ba4d3d998325]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:27 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:02:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93288b-a03d-420a-b2ce-10ecc222679b]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:27 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating existing volume attachment record: a7f6541d-704f-488f-9dba-8f5163e53c7b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:02:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:30 user nova-compute[75215]: INFO nova.compute.manager [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Terminating instance
Nov 29 15:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:02:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc is timed out.
Nov 29 15:02:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdb from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the live domain config.
Nov 29 15:02:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNyprAno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe0ad0f-f112-4461-ac56-407ae8d5283f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:02:30 user nova-compute[75215]: No targets found.
Nov 29 15:02:30 user nova-compute[75215]: iSNS:
Nov 29 15:02:30 user nova-compute[75215]: No targets found.
Nov 29 15:02:30 user nova-compute[75215]: STATIC:
Nov 29 15:02:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:02:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941
Nov 29 15:02:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a
Nov 29 15:02:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:02:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:02:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:30 user nova-compute[75215]: FIRMWARE:
Nov 29 15:02:30 user nova-compute[75215]: No targets found.
Nov 29 15:02:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:02:30 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:02:30 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062350b-c761-4beb-a292-2731d636c47e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4240bdb0-7a96-44e1-9517-1f30a086c93c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 (non-flash)
Nov 29 15:02:30 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c884556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a611bd-77ae-492f-b63d-8f3f067a0bc8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28a2f4-5c4a-43b0-a5e8-18d36ac9cf5d]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f185295-9b61-4266-9e4b-00f029dc8303]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae3d6198-db0e-4f14-833b-12834d847ba4 req-0c2d5d54-149c-421c-9e6f-4b6b5060448b service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-unplugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eadcf70-210d-4ff4-9fec-e9a8ebaf0fca]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60acb9f1-bedb-484f-be34-1973ae3a9793]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1e7562-6ed9-47ec-ad68-fd4460545a87]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260]
Nov 29 15:02:31 user nova-compute[75215]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a35892fd-7bb3-405b-92ec-cfa4ace47941 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a448b79d-10d5-4440-bd56-2f2a9d5879fc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== disconnect_volume: return (351ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:02:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Instance destroyed successfully.
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid 9ced07bb-dd04-4b80-98ee-64afe84ea0ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717667989',display_name='tempest-ServerRescueNegativeTestJSON-server-717667989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-717667989',id=29,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELoWMOCpUjfVjdT3005LPYUzA+zNZ76VnwUzay/FWAhq1czPWHUfyoD4EDyLkdPFx7SBdFImuVyNTSpI617Ea7wdifORSar4tRDlUh4tYavPoBKHI9oArt84kwg2Eix0Q==',key_name='tempest-keypair-848980801',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-7ya4mxl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b4b269cff8f482cbbd277204b42585b',uuid=9ced07bb-dd04-4b80-98ee-64afe84ea0ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "address": "fa:16:3e:1e:be:38", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c955ff-b2", "ovs_interfaceid": "98c955ff-b257-4fd5-98d0-c75d3b63287f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG os_vif [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98c955ff-b2, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=062d4787-d6a2-46d8-95af-b4f7ba9056c5) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:31 user nova-compute[75215]: INFO os_vif [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:be:38,bridge_name='br-int',has_traffic_filtering=True,id=98c955ff-b257-4fd5-98d0-c75d3b63287f,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c955ff-b2')
Nov 29 15:02:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Deleting instance files /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab_del
Nov 29 15:02:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Deletion of /opt/stack/data/nova/instances/9ced07bb-dd04-4b80-98ee-64afe84ea0ab_del complete
Nov 29 15:02:31 user nova-compute[75215]: INFO nova.compute.manager [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 15:02:31 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:02:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-22c9a6a6-6392-4e72-90c0-74ec4e49a7ee tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:32 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Took 0.67 seconds to deallocate network for instance.
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-229ea233-c061-459e-8120-fa31fc7d0899 req-d92bfa94-c66e-4441-a9d7-d30cc139d49a service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-deleted-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:32 user nova-compute[75215]: INFO nova.compute.manager [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Detaching volume e032e10a-eda4-410e-b071-cc2ec5b2191a
Nov 29 15:02:32 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Deleted allocations for instance 9ced07bb-dd04-4b80-98ee-64afe84ea0ab
Nov 29 15:02:32 user nova-compute[75215]: INFO nova.virt.block_device [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Attempting to driver detach volume e032e10a-eda4-410e-b071-cc2ec5b2191a from mountpoint /dev/vdc
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Attempting to detach device vdc from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:32 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:32 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 15:02:32 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:32 user nova-compute[75215]:   <serial>e032e10a-eda4-410e-b071-cc2ec5b2191a</serial>
Nov 29 15:02:32 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 15:02:32 user nova-compute[75215]: </disk>
Nov 29 15:02:32 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdc from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the persistent domain config.
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:32 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:32 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 29 15:02:32 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:32 user nova-compute[75215]:   <serial>e032e10a-eda4-410e-b071-cc2ec5b2191a</serial>
Nov 29 15:02:32 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 15:02:32 user nova-compute[75215]: </disk>
Nov 29 15:02:32 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ffafe511-173c-4fa0-ad77-208b9d330f3d tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] Acquiring lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] Lock "9ced07bb-dd04-4b80-98ee-64afe84ea0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] No waiting events found dispatching network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:02:33 user nova-compute[75215]: WARNING nova.compute.manager [req-5b891cfb-9f12-4af7-b07e-4e5e91b51cfc req-1a7f3a2c-0c4f-4ed9-8849-ea6d3d470d53 service nova] [instance: 9ced07bb-dd04-4b80-98ee-64afe84ea0ab] Received unexpected event network-vif-plugged-98c955ff-b257-4fd5-98d0-c75d3b63287f for instance with vm_state deleted and task_state None.
Nov 29 15:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:02:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oujeEBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:35 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60763288-3a45-44b5-9c56-3a742577b676]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:02:35 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e3a195-3f1a-40da-a870-5019ec6f0c33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d] added
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf32f2f-4a2a-4ea7-a38c-68dc8cd38a60]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce6e810-f72d-4189-a337-5dbeaa2a74b1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oujeEBRa {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oujeEBRa" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30724f22-6d87-4e84-b1cd-3ab37c8ae7b0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oujeEBRa'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da62da98-7b1a-469e-a212-238bfe446e91]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af697718-7b7f-4e39-9f2c-73a6995a9510]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900aa55-0bb0-42a5-9339-d19c62e9200d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260]
Nov 29 15:02:35 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c21b25-96cc-4b3d-8897-db9987bfb322]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d687be-c1c6-42ec-a3ff-a8e66ffa25bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:35 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf810b-d56c-4706-bdc2-792cbc0b7666]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oujeEBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26338643639333933', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338643639333933', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:02:36 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:36 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:02:36 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:02:36 user nova-compute[75215]:   <serial>25cc3808-e6c1-4f54-b3a2-215699be4b5d</serial>
Nov 29 15:02:36 user nova-compute[75215]: </disk>
Nov 29 15:02:36 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:02:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No VIF found with MAC fa:16:3e:b6:51:ef, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:02:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4e71a0ae-a7c2-4b30-99e2-dd1b8d2852ee tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.732s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:41 user nova-compute[75215]: INFO nova.compute.manager [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attaching volume ebde0f1f-223e-45c7-bc9e-69e767db9e4a to /dev/vdc
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.utils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f9780-30dd-4309-b50d-d17255dd64b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ae03a-7ea6-46ff-a03a-829479713aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[774ef17d-5750-4c54-aa25-4c5349c8c629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2f4b1-2e5c-4d61-ab48-63f70dff15ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:41 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:02:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f21320-0a25-492d-82a1-18f5d3b94695]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG os_brick.utils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:41 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating existing volume attachment record: 9efa490d-6291-441e-8253-380bddb10dff {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:02:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing instance network info cache due to event network-changed-804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Refreshing network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated VIF entry in instance network info cache for port 804ac5f2-692e-4630-8e3f-59e788ba0f28. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e688000b-d6b6-448e-90f4-a49fa84a2cf4 req-b25d7a5c-1af9-4529-adae-3a6c729860bd service nova] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Stashing vm_state: active {{(pid=75215) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 15:02:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:47 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:02:47 user nova-compute[75215]: INFO nova.compute.claims [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Claim successful on node user
Nov 29 15:02:48 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating resource usage from migration a170c601-ae7c-45f6-937c-846ea82b51ad
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-changed-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Refreshing instance network info cache due to event network-changed-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Refreshing network info cache for port 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.443s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:48 user nova-compute[75215]: INFO nova.compute.manager [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Migrating
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updated VIF entry in instance network info cache for port 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-da42ddeb-7646-4cba-9f02-fe9170f1180a req-c1406da1-7cc8-4d0a-ab6f-17a6b06eb392 service nova] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:02:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Starting migrate_disk_and_power_off {{(pid=75215) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:02:49 user nova-compute[75215]: WARNING nova.compute.manager [req-5bac17c3-f782-4ed5-8eb5-d35ffcbca1a6 req-265bd2e6-891c-493e-92d6-0b072d45f741 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state active and task_state resize_migrating.
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKiDjsnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:49 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068a33f-406a-4fd3-a9f9-2a5ab47e1f01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:02:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7733736f-d155-42a3-8f09-159352759445]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a] added
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215c9c8-1dd4-465f-8473-e6e370dbea4d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1fe42-30a7-4b8b-8fe7-16154c429941]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKiDjsnG {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKiDjsnG" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33925e-fb23-4eb0-8fd0-804f2bec01d3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uKiDjsnG'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda066e7-b3e8-4b20-94c5-fd6168fb8942]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf62ee40-551f-41e4-9652-121f341ea140]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f775233-a3e6-4de8-80ab-f6505427135c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260]
Nov 29 15:02:49 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c140769a-d727-4ef1-baac-504593dd62a9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance destroyed successfully.
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c82e40f-91, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=703faae5-6871-43d3-9dfb-24d4fc11e26d) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:49 user nova-compute[75215]: INFO os_vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91')
Nov 29 15:02:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec8b497-de62-40d1-9be0-d13ffa847e69]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:49 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fa8ed1-278d-4ec2-a265-fccca7d37fe1]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:02:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKiDjsnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26630393230303131', 'path': '/dev/sdg'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630393230303131', 'path': '/dev/sdg'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.044s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec5f7d3-a875-405a-ad5f-477d704ec8d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:02:50 user nova-compute[75215]: No targets found.
Nov 29 15:02:50 user nova-compute[75215]: iSNS:
Nov 29 15:02:50 user nova-compute[75215]: No targets found.
Nov 29 15:02:50 user nova-compute[75215]: STATIC:
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:02:50 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:50 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:50 user nova-compute[75215]: FIRMWARE:
Nov 29 15:02:50 user nova-compute[75215]: No targets found.
Nov 29 15:02:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:02:50 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:02:50 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:02:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:02:51 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:51 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:02:51 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:51 user nova-compute[75215]:   <serial>ebde0f1f-223e-45c7-bc9e-69e767db9e4a</serial>
Nov 29 15:02:51 user nova-compute[75215]: </disk>
Nov 29 15:02:51 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c365c007-a0f3-4c6a-888c-3f76f0b66611]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b8728-5e49-45c7-a552-f4b61887fc3b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:51 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac689240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a400d9e-98cd-4740-8317-12716b6b7bca]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdbd9c1-729d-4eb3-a37c-d60e50e79c3c]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628c08d-ab06-4977-8d81-afce96be65ae]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af1bfd-f76f-4780-bdf6-33b4ca51c433]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a8480-ddfd-4898-a754-4fa0f15eb824]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] No VIF found with MAC fa:16:3e:b6:51:ef, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:02:51 user nova-compute[75215]: WARNING nova.compute.manager [req-103d0dd8-f3d1-47d9-a4eb-af727c637f57 req-25d72e72-6849-47db-8021-3bdc3f06e495 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state active and task_state resize_migrating.
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b090cd41-09fa-4648-bc86-e23474e321cb]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]
Nov 29 15:02:51 user nova-compute[75215]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7712da51-ae8e-460c-b152-ae72916722df]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== disconnect_volume: return (1591ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:02:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b794b10-6130-4801-9212-3c870d966fa9 tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.117s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Port 8c82e40f-912f-4ec7-a5b8-7ceb93c3367d binding to destination host user is already ACTIVE {{(pid=75215) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:52 user nova-compute[75215]: INFO nova.compute.manager [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Detaching volume ebde0f1f-223e-45c7-bc9e-69e767db9e4a
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:02:52 user nova-compute[75215]: INFO nova.virt.block_device [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attempting to driver detach volume ebde0f1f-223e-45c7-bc9e-69e767db9e4a from mountpoint /dev/vdc
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Attempting to detach device vdc from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:52 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:52 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:02:52 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:52 user nova-compute[75215]:   <serial>ebde0f1f-223e-45c7-bc9e-69e767db9e4a</serial>
Nov 29 15:02:52 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 15:02:52 user nova-compute[75215]: </disk>
Nov 29 15:02:52 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully detached device vdc from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the persistent domain config.
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:02:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:02:52 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:02:52 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:02:52 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 29 15:02:52 user nova-compute[75215]:   <serial>ebde0f1f-223e-45c7-bc9e-69e767db9e4a</serial>
Nov 29 15:02:52 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 15:02:52 user nova-compute[75215]: </disk>
Nov 29 15:02:52 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:02:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc is timed out.
Nov 29 15:02:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:02:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully detached device vdc from instance 8ee90a2c-a7ec-443b-b913-33db128f07dc from the live domain config.
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXqvmSGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:02:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d260b-f11c-4832-95a3-05e7270bf0a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00d72b1-1a51-4b41-9e50-24172847d715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:02:53 user nova-compute[75215]: No targets found.
Nov 29 15:02:53 user nova-compute[75215]: iSNS:
Nov 29 15:02:53 user nova-compute[75215]: No targets found.
Nov 29 15:02:53 user nova-compute[75215]: STATIC:
Nov 29 15:02:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d
Nov 29 15:02:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:53 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:02:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:53 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a
Nov 29 15:02:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:53 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a
Nov 29 15:02:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:53 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:02:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:02:53 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:02:53 user nova-compute[75215]: FIRMWARE:
Nov 29 15:02:53 user nova-compute[75215]: No targets found.
Nov 29 15:02:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:02:53 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:02:53 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa05d3a-1c8f-4d1d-95e5-c18e73b938fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa9083-907f-4bfe-b782-0b5d3ce8d240]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[909aa4bd-1359-4932-9806-699191783861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61168f8-d105-479e-bac6-79565fead0fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2afa7b-4f36-4184-8412-10b7b44ae549]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:02:53 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:02:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac30a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:02:53 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9429760c-e150-47cb-9f86-299811138c36]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcd982a-cacc-48ec-8b05-4ee48ba0ff71]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a19cb-7528-4faa-a468-3e549400b353]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3199ef4-bf93-4e8f-92bf-3e2130736452]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d86c82-f698-418f-a3d3-36622193a686]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8850ade4-90df-4f05-92f4-673b8d91364e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f6a58-9671-4752-9212-8895ba27e095]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260]
Nov 29 15:02:53 user nova-compute[75215]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a, portal: 172.16.0.220,3260] successful.
Nov 29 15:02:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e032e10a-eda4-410e-b071-cc2ec5b2191a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[477fb396-f3df-4593-85f6-e8d54a97dcd2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] <== disconnect_volume: return (356ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:02:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:02:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'flavor' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d87b81-ff5f-47d7-a07f-4002d5ae9287 tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:57 user nova-compute[75215]: INFO nova.compute.manager [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Terminating instance
Nov 29 15:02:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-unplugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] No waiting events found dispatching network-vif-unplugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-98bc6218-4a14-4831-b09d-cca643f0f69e req-33280fc2-23f5-4e28-a03f-6e3895056993 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-unplugged-14ddadbd-807d-436c-b3a8-ca80400263e5 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:02:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Instance destroyed successfully.
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lazy-loading 'resources' on Instance uuid 8ee90a2c-a7ec-443b-b913-33db128f07dc {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-568374541',display_name='tempest-AttachVolumeTestJSON-server-568374541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-568374541',id=33,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOfYdAeNFyFZILI1mRQVmBrtB0a1QbTXR4QSM3LWRIor6RFuIJeH2hqL3lpxOTx/4eqd6GGZsUPCvXbINY8jagQubh0xnYyu9fjBxaF3K6R9chMf4+C8RWbrbCiBg+kDQ==',key_name='tempest-keypair-397499663',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f0dc3e9a4bc447a80d5983bbafe3059',ramdisk_id='',reservation_id='r-5ru00k1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1589123637',owner_user_name='tempest-AttachVolumeTestJSON-1589123637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc31705a39b4447a3ad96ca8d073144',uuid=8ee90a2c-a7ec-443b-b913-33db128f07dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converting VIF {"id": "14ddadbd-807d-436c-b3a8-ca80400263e5", "address": "fa:16:3e:6f:dc:24", "network": {"id": "e6383548-ad9a-4641-957b-ee2c02481e5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-118259811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0dc3e9a4bc447a80d5983bbafe3059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ddadbd-80", "ovs_interfaceid": "14ddadbd-807d-436c-b3a8-ca80400263e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG os_vif [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14ddadbd-80, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad4aa8f5-2078-4039-8f5b-dda4950fa1d1) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:02:58 user nova-compute[75215]: INFO os_vif [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=14ddadbd-807d-436c-b3a8-ca80400263e5,network=Network(e6383548-ad9a-4641-957b-ee2c02481e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ddadbd-80')
Nov 29 15:02:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Deleting instance files /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc_del
Nov 29 15:02:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Deletion of /opt/stack/data/nova/instances/8ee90a2c-a7ec-443b-b913-33db128f07dc_del complete
Nov 29 15:02:58 user nova-compute[75215]: INFO nova.compute.manager [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 15:02:58 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:02:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:02:59 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c5e9f4a-263f-4dcf-8b10-30a18f89618e req-b6362100-1d8f-4f9f-883b-f8a8387ac640 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-deleted-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:02:59 user nova-compute[75215]: INFO nova.compute.manager [req-0c5e9f4a-263f-4dcf-8b10-30a18f89618e req-b6362100-1d8f-4f9f-883b-f8a8387ac640 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Neutron deleted interface 14ddadbd-807d-436c-b3a8-ca80400263e5; detaching it from the instance and deleting it from the info cache
Nov 29 15:02:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-0c5e9f4a-263f-4dcf-8b10-30a18f89618e req-b6362100-1d8f-4f9f-883b-f8a8387ac640 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:02:59 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Took 1.02 seconds to deallocate network for instance.
Nov 29 15:02:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c5e9f4a-263f-4dcf-8b10-30a18f89618e req-b6362100-1d8f-4f9f-883b-f8a8387ac640 service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Detach interface failed, port_id=14ddadbd-807d-436c-b3a8-ca80400263e5, reason: Instance 8ee90a2c-a7ec-443b-b913-33db128f07dc could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:02:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:02:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] Acquiring lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] No waiting events found dispatching network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:00 user nova-compute[75215]: WARNING nova.compute.manager [req-8e95f135-734d-49f6-a1a1-ff4c29892930 req-0e6b01ff-0a3a-47d2-9999-7105eb50453d service nova] [instance: 8ee90a2c-a7ec-443b-b913-33db128f07dc] Received unexpected event network-vif-plugged-14ddadbd-807d-436c-b3a8-ca80400263e5 for instance with vm_state deleted and task_state None.
Nov 29 15:03:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:00 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Deleted allocations for instance 8ee90a2c-a7ec-443b-b913-33db128f07dc
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:03:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-514b13ad-46e2-4ec6-aa50-9cf623113c9e tempest-AttachVolumeTestJSON-1589123637 tempest-AttachVolumeTestJSON-1589123637-project-member] Lock "8ee90a2c-a7ec-443b-b913-33db128f07dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Starting finish_migration {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 15:03:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Creating image(s)
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Ensure instance console log exists: /opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start _get_guest_xml network_info=[{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c9f6e312-852a-4e6f-8897-84a63fe91282', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84a68868-1bdd-46a7-b821-ee205f6e1c38', 'attached_at': '2023-11-29T15:03:02.000000', 'detached_at': '', 'volume_id': '6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'serial': '6eba59e4-0f5e-4f4e-91e9-0b6e705f779a'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:03:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:03:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:03:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:03:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:03:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:03:02 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7518c2-9f4e-40fa-85d4-61d4baf1a5d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:03:02 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6481642-4cee-4218-a427-ba7c8592c679]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a] added
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6895cf-21c3-4d32-923f-e69fdf0b86c7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bade163-41ec-4106-874a-6b14588afab9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKjRWzPu {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKjRWzPu" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073529d-ab97-4be6-9768-2a518603b276]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKjRWzPu'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c12d030-7d59-4f44-9a9d-c3d6aa7e9582]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1eca6-15d1-47cd-b23c-6b84cb529c05]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3bccd7-4c54-4734-a553-36e7acc85e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]
Nov 29 15:03:02 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcff3ca-faf7-4c5d-90ca-baca84c28f64]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254a4b0-460d-4685-a4f3-3a3213371cda]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0949a-9251-4066-841e-9255fc406c14]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:03:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23930623338366431', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930623338366431', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:03:03 user nova-compute[75215]:   <uuid>84a68868-1bdd-46a7-b821-ee205f6e1c38</uuid>
Nov 29 15:03:03 user nova-compute[75215]:   <name>instance-00000023</name>
Nov 29 15:03:03 user nova-compute[75215]:   <memory>2097152</memory>
Nov 29 15:03:03 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:03:03 user nova-compute[75215]:   <metadata>
Nov 29 15:03:03 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:03:03 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:03:03 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-1093913007</nova:name>
Nov 29 15:03:03 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:03:01</nova:creationTime>
Nov 29 15:03:03 user nova-compute[75215]:       <nova:flavor name="m1.small">
Nov 29 15:03:03 user nova-compute[75215]:         <nova:memory>2048</nova:memory>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:disk>20</nova:disk>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:03:03 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:03:03 user nova-compute[75215]:       <nova:owner>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:user uuid="25bf6c00d9b340c78b2e136f22b2b211">tempest-ServerActionsTestOtherA-380950315-project-member</nova:user>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:project uuid="f9445b58a3554c19b57afbffbaa6a112">tempest-ServerActionsTestOtherA-380950315</nova:project>
Nov 29 15:03:03 user nova-compute[75215]:       </nova:owner>
Nov 29 15:03:03 user nova-compute[75215]:       <nova:ports>
Nov 29 15:03:03 user nova-compute[75215]:         <nova:port uuid="8c82e40f-912f-4ec7-a5b8-7ceb93c3367d">
Nov 29 15:03:03 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 15:03:03 user nova-compute[75215]:         </nova:port>
Nov 29 15:03:03 user nova-compute[75215]:       </nova:ports>
Nov 29 15:03:03 user nova-compute[75215]:     </nova:instance>
Nov 29 15:03:03 user nova-compute[75215]:   </metadata>
Nov 29 15:03:03 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:03:03 user nova-compute[75215]:     <system>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="serial">84a68868-1bdd-46a7-b821-ee205f6e1c38</entry>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="uuid">84a68868-1bdd-46a7-b821-ee205f6e1c38</entry>
Nov 29 15:03:03 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:03:03 user nova-compute[75215]:     </system>
Nov 29 15:03:03 user nova-compute[75215]:   </sysinfo>
Nov 29 15:03:03 user nova-compute[75215]:   <os>
Nov 29 15:03:03 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:03:03 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:03:03 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:03:03 user nova-compute[75215]:   </os>
Nov 29 15:03:03 user nova-compute[75215]:   <features>
Nov 29 15:03:03 user nova-compute[75215]:     <acpi/>
Nov 29 15:03:03 user nova-compute[75215]:     <apic/>
Nov 29 15:03:03 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:03:03 user nova-compute[75215]:   </features>
Nov 29 15:03:03 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:03:03 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:03:03 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:03:03 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:03:03 user nova-compute[75215]:   </clock>
Nov 29 15:03:03 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:03:03 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:03:03 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:03:03 user nova-compute[75215]:   </cpu>
Nov 29 15:03:03 user nova-compute[75215]:   <devices>
Nov 29 15:03:03 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:03:03 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:03:03 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 29 15:03:03 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:03:03 user nova-compute[75215]:       <serial>6eba59e4-0f5e-4f4e-91e9-0b6e705f779a</serial>
Nov 29 15:03:03 user nova-compute[75215]:     </disk>
Nov 29 15:03:03 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:03:03 user nova-compute[75215]:       <mac address="fa:16:3e:60:4f:e9"/>
Nov 29 15:03:03 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:03:03 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:03:03 user nova-compute[75215]:       <target dev="tap8c82e40f-91"/>
Nov 29 15:03:03 user nova-compute[75215]:     </interface>
Nov 29 15:03:03 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:03:03 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38/console.log" append="off"/>
Nov 29 15:03:03 user nova-compute[75215]:     </serial>
Nov 29 15:03:03 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:03:03 user nova-compute[75215]:     <video>
Nov 29 15:03:03 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:03:03 user nova-compute[75215]:     </video>
Nov 29 15:03:03 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:03:03 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:03:03 user nova-compute[75215]:     </rng>
Nov 29 15:03:03 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:03:03 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:03:03 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:03:03 user nova-compute[75215]:     </memballoon>
Nov 29 15:03:03 user nova-compute[75215]:   </devices>
Nov 29 15:03:03 user nova-compute[75215]: </domain>
Nov 29 15:03:03 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821343291-network", "vif_mac": "fa:16:3e:60:4f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG os_vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a991e8cb-6a45-5e00-88c9-e8383b637390', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c82e40f-91, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c82e40f-91, col_values=(('qos', UUID('69d12939-ebc4-4406-9849-347e42571ed9')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c82e40f-91, col_values=(('external_ids', {'iface-id': '8c82e40f-912f-4ec7-a5b8-7ceb93c3367d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:4f:e9', 'vm-uuid': '84a68868-1bdd-46a7-b821-ee205f6e1c38'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:03 user nova-compute[75215]: INFO os_vif [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91')
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] No VIF found with MAC fa:16:3e:60:4f:e9, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:04 user nova-compute[75215]: WARNING nova.compute.manager [req-18244b30-7ca4-43d1-a467-c1599551f21c req-ee2720cb-3f8d-4616-9f06-912a4ddad23e service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state active and task_state resize_finish.
Nov 29 15:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:05 user nova-compute[75215]: INFO nova.compute.manager [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Rescuing
Nov 29 15:03:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:03:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:03:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating instance_info_cache with network_info: [{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:06 user nova-compute[75215]: WARNING nova.compute.manager [req-15d99036-1821-4823-8f9e-cd5939f56c76 req-5170e399-01d5-4c70-8917-a67c8303a90d service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state rescuing.
Nov 29 15:03:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:03:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance running successfully.
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Failed to set time: agent not configured {{(pid=75215) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0f676ed-d4c3-49ea-b2c0-dd1d8e5c8999 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] finish_migration finished successfully. {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:06 user nova-compute[75215]: WARNING nova.compute.manager [req-eb632cac-8574-42a7-b798-c515480843d9 req-e826a3e0-b926-44e9-9295-6aa0ffd1008a service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state active and task_state resize_finish.
Nov 29 15:03:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance destroyed successfully.
Nov 29 15:03:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Attempting a stable device rescue
Nov 29 15:03:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 15:03:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Creating image(s)
Nov 29 15:03:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "8adb5bd2e069eb647c2243574d39046eabd39327" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "8adb5bd2e069eb647c2243574d39046eabd39327" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG nova.virt.images [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] f9f01947-b33a-49d4-bc92-007d8efcadee was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.part /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:08 user nova-compute[75215]: WARNING nova.compute.manager [req-ce1f1f89-3c17-4986-a02f-5da867b66d60 req-ee47ff36-5c1e-4cd6-8179-29d236f5eb97 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state rescuing.
Nov 29 15:03:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.part /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.converted" returned: 0 in 0.440s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "8adb5bd2e069eb647c2243574d39046eabd39327" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.926s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "8adb5bd2e069eb647c2243574d39046eabd39327" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "8adb5bd2e069eb647c2243574d39046eabd39327" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327 --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327,backing_fmt=raw /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327,backing_fmt=raw /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue" returned: 0 in 0.061s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "8adb5bd2e069eb647c2243574d39046eabd39327" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'migration_context' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<e4a39cd7-cd54-49f6-8e92-a272fc3f043a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start _get_guest_xml network_info=[{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:a9:23:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9f01947-b33a-49d4-bc92-007d8efcadee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'de825bc7-7886-4853-8953-15f61c9fb9ac', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e4a39cd7-cd54-49f6-8e92-a272fc3f043a', 'attached_at': '', 'detached_at': '', 'volume_id': '39033451-8732-4cbb-8410-d06b9a60e79e', 'serial': '39033451-8732-4cbb-8410-d06b9a60e79e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<e4a39cd7-cd54-49f6-8e92-a272fc3f043a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'numa_topology' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<e4a39cd7-cd54-49f6-8e92-a272fc3f043a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:03:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<e4a39cd7-cd54-49f6-8e92-a272fc3f043a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:03:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:03:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:03:09 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856dcae-9a6a-4135-bf42-08b62ccef50c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iQVFGUas\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 15:03:09 user nova-compute[75215]: node.name = iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:03:09 user nova-compute[75215]: node.tpgt = -1
Nov 29 15:03:09 user nova-compute[75215]: node.startup = automatic
Nov 29 15:03:09 user nova-compute[75215]: node.leading_login = No
Nov 29 15:03:09 user nova-compute[75215]: iface.iscsi_ifacename = default
Nov 29 15:03:09 user nova-compute[75215]: iface.net_ifacename = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.ipaddress = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.prefix_len = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.hwaddress = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.transport_name = tcp
Nov 29 15:03:09 user nova-compute[75215]: iface.initiatorname = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.vlan_id = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.vlan_priority = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.vlan_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.iface_num = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.mtu = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.port = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.bootproto = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.subnet_mask = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.gateway = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_alt_client_id = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_dns = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_learn_iqn = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_vendor_id_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_vendor_id = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.dhcp_slp_da = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.fragmentation = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.gratuitous_arp = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.incoming_forwarding = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.tos_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.tos = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.ttl = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.delayed_ack = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.tcp_nagle = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.tcp_wsf_state = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.tcp_wsf = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.tcp_timer_scale = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.tcp_timestamp = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.redirect = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.def_task_mgmt_timeout = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.header_digest = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.data_digest = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.immediate_data = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.initial_r2t = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.data_seq_inorder = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.data_pdu_inorder = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.erl = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.max_receive_data_len = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.first_burst_len = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.max_outstanding_r2t = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.max_burst_len = 0
Nov 29 15:03:09 user nova-compute[75215]: iface.chap_auth = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.bidi_chap = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.strict_login_compliance = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.discovery_auth = <empty>
Nov 29 15:03:09 user nova-compute[75215]: iface.discovery_logout = <empty>
Nov 29 15:03:09 user nova-compute[75215]: node.discovery_address = <empty>
Nov 29 15:03:09 user nova-compute[75215]: node.discovery_port = 0
Nov 29 15:03:09 user nova-compute[75215]: node.discovery_type = static
Nov 29 15:03:09 user nova-compute[75215]: node.session.initial_cmdsn = 0
Nov 29 15:03:09 user nova-compute[75215]: node.session.initial_login_retry_max = 8
Nov 29 15:03:09 user nova-compute[75215]: node.session.xmit_thread_priority = -20
Nov 29 15:03:09 user nova-compute[75215]: node.session.cmds_max = 128
Nov 29 15:03:09 user nova-compute[75215]: node.session.queue_depth = 32
Nov 29 15:03:09 user nova-compute[75215]: node.session.nr_sessions = 1
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.authmethod = CHAP
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.username = iQVFGUas
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.password = ***
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.username_in = <empty>
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.password_in = <empty>
Nov 29 15:03:09 user nova-compute[75215]: node.session.auth.chap_algs = MD5
Nov 29 15:03:09 user nova-compute[75215]: node.session.timeo.replacement_timeout = 120
Nov 29 15:03:09 user nova-compute[75215]: node.session.err_timeo.abort_timeout = 15
Nov 29 15:03:09 user nova-compute[75215]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 15:03:09 user nova-compute[75215]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 15:03:09 user nova-compute[75215]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.FastAbort = Yes
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.InitialR2T = No
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.ImmediateData = Yes
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.MaxConnections = 1
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 15:03:09 user nova-compute[75215]: node.session.iscsi.ERL = 0
Nov 29 15:03:09 user nova-compute[75215]: node.session.scan = manual
Nov 29 15:03:09 user nova-compute[75215]: node.session.reopen_max = 0
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].address = 172.16.0.220
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].port = 3260
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].startup = manual
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].tcp.window_size = 524288
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].tcp.type_of_service = 0
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].timeo.logout_timeout = 15
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].timeo.login_timeout = 15
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].timeo.auth_timeout = 45
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.DataDigest = None
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.IFMarker = No
Nov 29 15:03:09 user nova-compute[75215]: node.conn[0].iscsi.OFMarker = No
Nov 29 15:03:09 user nova-compute[75215]: # END RECORD
Nov 29 15:03:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8666ad-7042-495d-8afd-ceac183a63e6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d90d437-d2eb-4c87-a736-e3d109b4861d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQVFGUas {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQVFGUas" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c4716-d035-4dee-8e0f-bd13b125cf54]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQVFGUas'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278e1ae-9f71-4ed0-8644-889d20ad367f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68926e1-daea-41c7-a933-52d631d54ecc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:09 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d973d8-f6ee-4c10-9a3c-ad1f69bc9984]: (4, ('0 0 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23563343932356233', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563343932356233', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145400785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145400785',id=36,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-4zazwqw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:01:35Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=e4a39cd7-cd54-49f6-8e92-a272fc3f043a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:a9:23:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "vif_mac": "fa:16:3e:a9:23:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Object Instance<e4a39cd7-cd54-49f6-8e92-a272fc3f043a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:03:09 user nova-compute[75215]:   <uuid>e4a39cd7-cd54-49f6-8e92-a272fc3f043a</uuid>
Nov 29 15:03:09 user nova-compute[75215]:   <name>instance-00000024</name>
Nov 29 15:03:09 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:03:09 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:03:09 user nova-compute[75215]:   <metadata>
Nov 29 15:03:09 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:03:09 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2145400785</nova:name>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:03:09</nova:creationTime>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:03:09 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:03:09 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:owner>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:user uuid="0fad9c93f4ea491880e3cd7a97518367">tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member</nova:user>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:project uuid="a72c331f6f384976bc971f9318b7d0b3">tempest-ServerBootFromVolumeStableRescueTest-1826785629</nova:project>
Nov 29 15:03:09 user nova-compute[75215]:       </nova:owner>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:03:09 user nova-compute[75215]:       <nova:ports>
Nov 29 15:03:09 user nova-compute[75215]:         <nova:port uuid="62f4d3fc-9d76-4181-9c32-ca7a09fbeb73">
Nov 29 15:03:09 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 15:03:09 user nova-compute[75215]:         </nova:port>
Nov 29 15:03:09 user nova-compute[75215]:       </nova:ports>
Nov 29 15:03:09 user nova-compute[75215]:     </nova:instance>
Nov 29 15:03:09 user nova-compute[75215]:   </metadata>
Nov 29 15:03:09 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:03:09 user nova-compute[75215]:     <system>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="serial">e4a39cd7-cd54-49f6-8e92-a272fc3f043a</entry>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="uuid">e4a39cd7-cd54-49f6-8e92-a272fc3f043a</entry>
Nov 29 15:03:09 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:03:09 user nova-compute[75215]:     </system>
Nov 29 15:03:09 user nova-compute[75215]:   </sysinfo>
Nov 29 15:03:09 user nova-compute[75215]:   <os>
Nov 29 15:03:09 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:03:09 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:03:09 user nova-compute[75215]:   </os>
Nov 29 15:03:09 user nova-compute[75215]:   <features>
Nov 29 15:03:09 user nova-compute[75215]:     <acpi/>
Nov 29 15:03:09 user nova-compute[75215]:     <apic/>
Nov 29 15:03:09 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:03:09 user nova-compute[75215]:   </features>
Nov 29 15:03:09 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:03:09 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:03:09 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:03:09 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:03:09 user nova-compute[75215]:   </clock>
Nov 29 15:03:09 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:03:09 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:03:09 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:03:09 user nova-compute[75215]:   </cpu>
Nov 29 15:03:09 user nova-compute[75215]:   <devices>
Nov 29 15:03:09 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:03:09 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:03:09 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:03:09 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:03:09 user nova-compute[75215]:       <serial>39033451-8732-4cbb-8410-d06b9a60e79e</serial>
Nov 29 15:03:09 user nova-compute[75215]:     </disk>
Nov 29 15:03:09 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:03:09 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:03:09 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue"/>
Nov 29 15:03:09 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 15:03:09 user nova-compute[75215]:       <boot order="1"/>
Nov 29 15:03:09 user nova-compute[75215]:     </disk>
Nov 29 15:03:09 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:03:09 user nova-compute[75215]:       <mac address="fa:16:3e:a9:23:09"/>
Nov 29 15:03:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:03:09 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:03:09 user nova-compute[75215]:       <target dev="tap62f4d3fc-9d"/>
Nov 29 15:03:09 user nova-compute[75215]:     </interface>
Nov 29 15:03:09 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:03:09 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/console.log" append="off"/>
Nov 29 15:03:09 user nova-compute[75215]:     </serial>
Nov 29 15:03:09 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:03:09 user nova-compute[75215]:     <video>
Nov 29 15:03:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:03:09 user nova-compute[75215]:     </video>
Nov 29 15:03:09 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:03:09 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:03:09 user nova-compute[75215]:     </rng>
Nov 29 15:03:09 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:03:09 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:03:09 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:03:09 user nova-compute[75215]:     </memballoon>
Nov 29 15:03:09 user nova-compute[75215]:   </devices>
Nov 29 15:03:09 user nova-compute[75215]: </domain>
Nov 29 15:03:09 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:03:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance destroyed successfully.
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:03:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] No VIF found with MAC fa:16:3e:a9:23:09, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:03:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:11 user nova-compute[75215]: WARNING nova.compute.manager [req-2071018e-8caf-4966-b6a3-3ff70039fcd0 req-355a7bb7-6baf-429b-b89c-2ba46bdfb3ea service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state rescuing.
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 is timed out.
Nov 29 15:03:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully detached device vdc from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the live domain config.
Nov 29 15:03:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKiDjsnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:03:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fb705c-694b-47e3-9e97-6321754e7131]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:03:13 user nova-compute[75215]: No targets found.
Nov 29 15:03:13 user nova-compute[75215]: iSNS:
Nov 29 15:03:13 user nova-compute[75215]: No targets found.
Nov 29 15:03:13 user nova-compute[75215]: STATIC:
Nov 29 15:03:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d
Nov 29 15:03:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:03:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:03:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:03:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:03:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:03:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a
Nov 29 15:03:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:03:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:03:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:03:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:03:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:03:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:03:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:03:13 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:03:13 user nova-compute[75215]: FIRMWARE:
Nov 29 15:03:13 user nova-compute[75215]: No targets found.
Nov 29 15:03:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:03:13 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:03:13 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5739499-01a4-4b08-8815-31072b640f24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:13 user nova-compute[75215]: WARNING nova.compute.manager [req-8905b8ae-77d0-4aca-858f-72b4bc6bcc74 req-d2803758-572f-4a6f-835f-3dfd003699a3 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state rescuing.
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[439053ea-ea26-4e37-8b66-25a527792ab0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a (non-flash)
Nov 29 15:03:13 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:03:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885977f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a'): ({'sdg'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Removing single pathed devices sdg {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37dbf5a-f677-40a4-a948-3070934b9b3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab1417-17cd-4a6a-99c2-56ceadcc1e1f]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Flushing IO for device /dev/sdg {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f2bca6-9c1d-4f8e-a9ce-3e432e15fd07]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6793f-869c-4ff1-a2f3-60300e8d91ff]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d4090-3d9b-42e7-be2a-779fc518b1eb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[54674cd3-77fc-4c0b-9e32-494b83608417]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260]
Nov 29 15:03:13 user nova-compute[75215]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a, portal: 172.16.0.220,3260] successful.
Nov 29 15:03:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2402f8ee-febb-4f1a-bfa9-b3c1fb539f49 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebde0f1f-223e-45c7-bc9e-69e767db9e4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ca1f0-9518-488c-87b3-dd753c8bf031]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== disconnect_volume: return (475ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e9d9b2ca-a008-4925-9dd8-c2e55991e14b tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:03:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:03:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8318MB free_disk=24.64940643310547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Applying migration context for instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 as it has an incoming, in-progress migration a170c601-ae7c-45f6-937c-846ea82b51ad. Migration status is finished {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 15:03:15 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating resource usage from migration a170c601-ae7c-45f6-937c-846ea82b51ad
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 46d6a29d-1f74-42b8-b87d-655d72921a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Migration a170c601-ae7c-45f6-937c-846ea82b51ad is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:03:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:03:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:03:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:35 user nova-compute[75215]: INFO nova.compute.manager [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Terminating instance
Nov 29 15:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad6512bb-6b23-4d09-a401-dbfb43d04a60 req-311bd001-7e19-48bc-890a-c3a68057296f service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-unplugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Instance destroyed successfully.
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid 8941f1e0-c109-43be-a997-fedcfd1c8e99 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1380020231',display_name='tempest-ServerRescueNegativeTestJSON-server-1380020231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1380020231',id=14,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-9aeuqnxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:49:20Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=8941f1e0-c109-43be-a997-fedcfd1c8e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "address": "fa:16:3e:54:df:ee", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bef3c5-f5", "ovs_interfaceid": "c6bef3c5-f538-4694-a27a-b633fd02f0f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG os_vif [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6bef3c5-f5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7390b7f4-9efc-455c-bc26-cff17335b943) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:03:36 user nova-compute[75215]: INFO os_vif [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=c6bef3c5-f538-4694-a27a-b633fd02f0f6,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bef3c5-f5')
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Deleting instance files /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99_del
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Deletion of /opt/stack/data/nova/instances/8941f1e0-c109-43be-a997-fedcfd1c8e99_del complete
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.compute.manager [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 29 15:03:36 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Took 0.63 seconds to deallocate network for instance.
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-de2c7a85-6db0-46d5-a74c-7ebca1e56154 req-6eb889b5-d574-4a69-a985-ce00834fc439 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-deleted-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:36 user nova-compute[75215]: INFO nova.compute.manager [req-de2c7a85-6db0-46d5-a74c-7ebca1e56154 req-6eb889b5-d574-4a69-a985-ce00834fc439 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Neutron deleted interface c6bef3c5-f538-4694-a27a-b633fd02f0f6; detaching it from the instance and deleting it from the info cache
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-de2c7a85-6db0-46d5-a74c-7ebca1e56154 req-6eb889b5-d574-4a69-a985-ce00834fc439 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-de2c7a85-6db0-46d5-a74c-7ebca1e56154 req-6eb889b5-d574-4a69-a985-ce00834fc439 service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Detach interface failed, port_id=c6bef3c5-f538-4694-a27a-b633fd02f0f6, reason: Instance 8941f1e0-c109-43be-a997-fedcfd1c8e99 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:37 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Deleted allocations for instance 8941f1e0-c109-43be-a997-fedcfd1c8e99
Nov 29 15:03:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0494b9a6-dcc6-4d86-b3a6-d3867d29340b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.362s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] Acquiring lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] Lock "8941f1e0-c109-43be-a997-fedcfd1c8e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:03:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] No waiting events found dispatching network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:03:37 user nova-compute[75215]: WARNING nova.compute.manager [req-f7729ea5-07b9-4a38-898f-9164ac4290fe req-ee5e2de0-fbef-4a1b-ac8a-2b29f89c560a service nova] [instance: 8941f1e0-c109-43be-a997-fedcfd1c8e99] Received unexpected event network-vif-plugged-c6bef3c5-f538-4694-a27a-b633fd02f0f6 for instance with vm_state deleted and task_state None.
Nov 29 15:03:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:03:43 user nova-compute[75215]: INFO nova.compute.manager [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Detaching volume 25cc3808-e6c1-4f54-b3a2-215699be4b5d
Nov 29 15:03:43 user nova-compute[75215]: INFO nova.virt.block_device [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Attempting to driver detach volume 25cc3808-e6c1-4f54-b3a2-215699be4b5d from mountpoint /dev/vdb
Nov 29 15:03:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Attempting to detach device vdb from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:03:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:03:43 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:03:43 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:03:43 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:03:43 user nova-compute[75215]:   <serial>25cc3808-e6c1-4f54-b3a2-215699be4b5d</serial>
Nov 29 15:03:43 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:03:43 user nova-compute[75215]: </disk>
Nov 29 15:03:43 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:03:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully detached device vdb from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the persistent domain config.
Nov 29 15:03:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:03:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:03:43 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:03:43 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 29 15:03:43 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:03:43 user nova-compute[75215]:   <serial>25cc3808-e6c1-4f54-b3a2-215699be4b5d</serial>
Nov 29 15:03:43 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:03:43 user nova-compute[75215]: </disk>
Nov 29 15:03:43 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:03:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:03:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:03:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:04:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [{"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-ec51da57-b873-4e98-8267-e0d72c5e9097" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:04:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 is timed out.
Nov 29 15:04:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully detached device vdb from instance 46d6a29d-1f74-42b8-b87d-655d72921a16 from the live domain config.
Nov 29 15:04:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oujeEBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:04:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735a4a7-7e13-4f3d-85c0-fdb7fd2fcef7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:04:04 user nova-compute[75215]: No targets found.
Nov 29 15:04:04 user nova-compute[75215]: iSNS:
Nov 29 15:04:04 user nova-compute[75215]: No targets found.
Nov 29 15:04:04 user nova-compute[75215]: STATIC:
Nov 29 15:04:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d
Nov 29 15:04:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:04:04 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:04:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:04:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:04:04 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:04:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:04:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:04:04 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:04:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:04:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:04:04 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:04:04 user nova-compute[75215]: FIRMWARE:
Nov 29 15:04:04 user nova-compute[75215]: No targets found.
Nov 29 15:04:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:04:04 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:04:04 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2341c-989a-4b92-b043-a41316ec3648]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7465e-6df9-4cd0-b611-5e5f141eb500]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:04:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d (non-flash)
Nov 29 15:04:04 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:04:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c887de0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa88c9-cd48-4f8c-9a4a-7774a04ce40f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b8bf8-0cc3-4a63-9149-425010e9c05b]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd5ea9-3dba-45e3-aead-fbeea3df7738]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125185f-bfb6-47c4-8d5a-23a3ebca1790]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c8067-3825-45f8-a6ac-01c2e26b9d55]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e2e25-db86-4218-82fa-24bf36805d54]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260]
Nov 29 15:04:04 user nova-compute[75215]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d, portal: 172.16.0.220,3260] successful.
Nov 29 15:04:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cc3808-e6c1-4f54-b3a2-215699be4b5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3512b70-89cf-42d5-8b33-426743dc4f56]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] <== disconnect_volume: return (313ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:04:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'flavor' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f6f6f1e4-e7d7-4aea-a73a-dcb032e73c6a tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.086s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:04:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8078MB free_disk=24.672149658203125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Applying migration context for instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 as it has an incoming, in-progress migration a170c601-ae7c-45f6-937c-846ea82b51ad. Migration status is finished {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 15:04:15 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating resource usage from migration a170c601-ae7c-45f6-937c-846ea82b51ad
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance a7d3b8e1-c2b3-4175-aef6-db44f969b212 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 46d6a29d-1f74-42b8-b87d-655d72921a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Migration a170c601-ae7c-45f6-937c-846ea82b51ad is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:04:18 user nova-compute[75215]: INFO nova.compute.claims [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Claim successful on node user
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:04:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.policy [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f590ceb1f6104a838b60c17b79e610c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27c9255ad994fc5b5a61fd9afa8d3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:04:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Creating image(s)
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "/opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "/opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk 1073741824" returned: 0 in 0.061s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Successfully created port: 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Cannot resize image /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Ensure instance console log exists: /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Successfully updated port: 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquired lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-changed-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Refreshing instance network info cache due to event network-changed-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] Acquiring lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updating instance_info_cache with network_info: [{"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Releasing lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Instance network_info: |[{"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] Acquired lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Refreshing network info cache for port 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Start _get_guest_xml network_info=[{"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:04:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:04:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1606903681',display_name='tempest-VolumesSnapshotTestJSON-instance-1606903681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1606903681',id=37,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGp48AmO9T6kli+zTIdP/7b1CH5sjoR+aHjpgtoOlDyGhhnH8cJ433X0lGUutW30tJ3wkk/HaBT1rwqp5hlQQc+X7oQQ/q4XN8gilOpUgNsseuTRGzlyhJBrXzUknuPV3g==',key_name='tempest-keypair-1188163397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-52ajtecp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=0bdfc35a-1f83-4fc9-8b8e-e61312246847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:04:21 user nova-compute[75215]:   <uuid>0bdfc35a-1f83-4fc9-8b8e-e61312246847</uuid>
Nov 29 15:04:21 user nova-compute[75215]:   <name>instance-00000025</name>
Nov 29 15:04:21 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:04:21 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:04:21 user nova-compute[75215]:   <metadata>
Nov 29 15:04:21 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:04:21 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1606903681</nova:name>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:04:21</nova:creationTime>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:04:21 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:04:21 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:owner>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:user uuid="f590ceb1f6104a838b60c17b79e610c0">tempest-VolumesSnapshotTestJSON-1046316634-project-member</nova:user>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:project uuid="f27c9255ad994fc5b5a61fd9afa8d3e6">tempest-VolumesSnapshotTestJSON-1046316634</nova:project>
Nov 29 15:04:21 user nova-compute[75215]:       </nova:owner>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:04:21 user nova-compute[75215]:       <nova:ports>
Nov 29 15:04:21 user nova-compute[75215]:         <nova:port uuid="4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2">
Nov 29 15:04:21 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 15:04:21 user nova-compute[75215]:         </nova:port>
Nov 29 15:04:21 user nova-compute[75215]:       </nova:ports>
Nov 29 15:04:21 user nova-compute[75215]:     </nova:instance>
Nov 29 15:04:21 user nova-compute[75215]:   </metadata>
Nov 29 15:04:21 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:04:21 user nova-compute[75215]:     <system>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="serial">0bdfc35a-1f83-4fc9-8b8e-e61312246847</entry>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="uuid">0bdfc35a-1f83-4fc9-8b8e-e61312246847</entry>
Nov 29 15:04:21 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:04:21 user nova-compute[75215]:     </system>
Nov 29 15:04:21 user nova-compute[75215]:   </sysinfo>
Nov 29 15:04:21 user nova-compute[75215]:   <os>
Nov 29 15:04:21 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:04:21 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:04:21 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:04:21 user nova-compute[75215]:   </os>
Nov 29 15:04:21 user nova-compute[75215]:   <features>
Nov 29 15:04:21 user nova-compute[75215]:     <acpi/>
Nov 29 15:04:21 user nova-compute[75215]:     <apic/>
Nov 29 15:04:21 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:04:21 user nova-compute[75215]:   </features>
Nov 29 15:04:21 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:04:21 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:04:21 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:04:21 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:04:21 user nova-compute[75215]:   </clock>
Nov 29 15:04:21 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:04:21 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:04:21 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:04:21 user nova-compute[75215]:   </cpu>
Nov 29 15:04:21 user nova-compute[75215]:   <devices>
Nov 29 15:04:21 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:04:21 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:04:21 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk"/>
Nov 29 15:04:21 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:04:21 user nova-compute[75215]:     </disk>
Nov 29 15:04:21 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:04:21 user nova-compute[75215]:       <mac address="fa:16:3e:02:51:48"/>
Nov 29 15:04:21 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:04:21 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:04:21 user nova-compute[75215]:       <target dev="tap4c194e94-a4"/>
Nov 29 15:04:21 user nova-compute[75215]:     </interface>
Nov 29 15:04:21 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:04:21 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/console.log" append="off"/>
Nov 29 15:04:21 user nova-compute[75215]:     </serial>
Nov 29 15:04:21 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:04:21 user nova-compute[75215]:     <video>
Nov 29 15:04:21 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:04:21 user nova-compute[75215]:     </video>
Nov 29 15:04:21 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:04:21 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:04:21 user nova-compute[75215]:     </rng>
Nov 29 15:04:21 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:04:21 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:04:21 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:04:21 user nova-compute[75215]:     </memballoon>
Nov 29 15:04:21 user nova-compute[75215]:   </devices>
Nov 29 15:04:21 user nova-compute[75215]: </domain>
Nov 29 15:04:21 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1606903681',display_name='tempest-VolumesSnapshotTestJSON-instance-1606903681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1606903681',id=37,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGp48AmO9T6kli+zTIdP/7b1CH5sjoR+aHjpgtoOlDyGhhnH8cJ433X0lGUutW30tJ3wkk/HaBT1rwqp5hlQQc+X7oQQ/q4XN8gilOpUgNsseuTRGzlyhJBrXzUknuPV3g==',key_name='tempest-keypair-1188163397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-52ajtecp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=0bdfc35a-1f83-4fc9-8b8e-e61312246847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG os_vif [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '430c7b9c-14ef-5926-9475-eefcdcb64d89', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c194e94-a4, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c194e94-a4, col_values=(('qos', UUID('44eb8069-ba18-49ba-8281-da9be600b256')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c194e94-a4, col_values=(('external_ids', {'iface-id': '4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:51:48', 'vm-uuid': '0bdfc35a-1f83-4fc9-8b8e-e61312246847'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:21 user nova-compute[75215]: INFO os_vif [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4')
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No VIF found with MAC fa:16:3e:02:51:48, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updated VIF entry in instance network info cache for port 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updating instance_info_cache with network_info: [{"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b607189-0729-465a-99c9-f41ae238f5a0 req-37abf2ae-7393-487d-8114-4c549438b9b5 service nova] Releasing lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] No waiting events found dispatching network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:22 user nova-compute[75215]: WARNING nova.compute.manager [req-6e7f32fb-26d9-48bc-a0d2-56b6c16271c3 req-eb5dae4e-abcc-4b5b-9d90-3f8659794128 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received unexpected event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 for instance with vm_state building and task_state spawning.
Nov 29 15:04:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:04:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Instance spawned successfully.
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] No waiting events found dispatching network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:25 user nova-compute[75215]: WARNING nova.compute.manager [req-b0297d3f-8001-47b1-95a6-dbe24f1943fa req-72d54988-ca25-42b0-9ae2-87ca5d0b8dca service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received unexpected event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 for instance with vm_state building and task_state spawning.
Nov 29 15:04:25 user nova-compute[75215]: INFO nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 29 15:04:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:04:25 user nova-compute[75215]: INFO nova.compute.manager [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Took 7.00 seconds to build instance.
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6934e8d-7279-42d9-83c5-0e4a6fe6e6b6 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.104s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:25 user nova-compute[75215]: INFO nova.compute.manager [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Terminating instance
Nov 29 15:04:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-56438ee7-b5c7-4951-adff-182405cedfcd req-055473e1-d961-44bf-a512-2c1508cb67ee service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-unplugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Instance destroyed successfully.
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lazy-loading 'resources' on Instance uuid a7d3b8e1-c2b3-4175-aef6-db44f969b212 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-402449986',display_name='tempest-ServerRescueNegativeTestJSON-server-402449986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-402449986',id=13,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:52:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf3e2fbd35cd4dc89ed674708af95612',ramdisk_id='',reservation_id='r-dnyei47m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1399489520',owner_user_name='tempest-ServerRescueNegativeTestJSON-1399489520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:54:05Z,user_data=None,user_id='4b4b269cff8f482cbbd277204b42585b',uuid=a7d3b8e1-c2b3-4175-aef6-db44f969b212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converting VIF {"id": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "address": "fa:16:3e:48:3d:b0", "network": {"id": "2201dfe7-7c00-4d1a-9003-a94511ddc4d8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1535083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf3e2fbd35cd4dc89ed674708af95612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa984b5ed-56", "ovs_interfaceid": "a984b5ed-5634-4973-97b8-a16a84dd6a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG os_vif [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa984b5ed-56, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ad361f0-2348-4efd-bc73-86dd7e7628d8) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:26 user nova-compute[75215]: INFO os_vif [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:3d:b0,bridge_name='br-int',has_traffic_filtering=True,id=a984b5ed-5634-4973-97b8-a16a84dd6a18,network=Network(2201dfe7-7c00-4d1a-9003-a94511ddc4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa984b5ed-56')
Nov 29 15:04:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Deleting instance files /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212_del
Nov 29 15:04:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Deletion of /opt/stack/data/nova/instances/a7d3b8e1-c2b3-4175-aef6-db44f969b212_del complete
Nov 29 15:04:26 user nova-compute[75215]: INFO nova.compute.manager [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 15:04:26 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:04:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:27 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Took 0.48 seconds to deallocate network for instance.
Nov 29 15:04:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-cb8287ff-840f-41a7-a82d-dd7599672d05 req-63806008-35ed-4316-ac9d-3998a525fd55 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-deleted-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:27 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Deleted allocations for instance a7d3b8e1-c2b3-4175-aef6-db44f969b212
Nov 29 15:04:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae17fd1b-e0e9-4211-a146-71f7d7ac201b tempest-ServerRescueNegativeTestJSON-1399489520 tempest-ServerRescueNegativeTestJSON-1399489520-project-member] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] Acquiring lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] Lock "a7d3b8e1-c2b3-4175-aef6-db44f969b212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] No waiting events found dispatching network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:28 user nova-compute[75215]: WARNING nova.compute.manager [req-31b66c5b-271d-4d1c-a54e-2fa33e2da044 req-8dc4ae05-7e9b-415e-8756-fcbce0b197f2 service nova] [instance: a7d3b8e1-c2b3-4175-aef6-db44f969b212] Received unexpected event network-vif-plugged-a984b5ed-5634-4973-97b8-a16a84dd6a18 for instance with vm_state deleted and task_state None.
Nov 29 15:04:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:33 user nova-compute[75215]: INFO nova.compute.manager [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Terminating instance
Nov 29 15:04:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-unplugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] No waiting events found dispatching network-vif-unplugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-4a8e64e1-90f3-4b87-b512-da5d3d1f53c7 req-df4f5901-143c-4ec9-b32c-7a66c1f9c4aa service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-unplugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:04:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Instance destroyed successfully.
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lazy-loading 'resources' on Instance uuid 46d6a29d-1f74-42b8-b87d-655d72921a16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1675757983',display_name='tempest-TestServerVolumeAttachmentScenario-server-1675757983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1675757983',id=34,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKePCh5BKAN7dI1bZDFa6l73IH/a7KOlNmmT5vPZmdhJZSGLywtQxhkt8Nlzxo7kn+P6AdG9h1ZQaOE64b3bkaJZHv/iwscQycyVlwz5vS9Gf+4L8+PRoACtARaoYPhShw==',key_name='tempest-keypair-1256072035',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbc1332b3ee44c5f9db4adb4c5f47ad6',ramdisk_id='',reservation_id='r-iv4mr8d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-462922840',owner_user_name='tempest-TestServerVolumeAttachmentScenario-462922840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a144c1faa35441158dbefe210c75e7a8',uuid=46d6a29d-1f74-42b8-b87d-655d72921a16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converting VIF {"id": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "address": "fa:16:3e:b6:51:ef", "network": {"id": "fe185b52-f695-4652-a43c-5794cab81101", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2116663783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc1332b3ee44c5f9db4adb4c5f47ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae0a60b-29", "ovs_interfaceid": "7ae0a60b-2957-4c40-bd81-5a0b9707f40a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG os_vif [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ae0a60b-29, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c78018c-39a8-45a5-ab60-f4da53c32819) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:04:34 user nova-compute[75215]: INFO os_vif [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:51:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ae0a60b-2957-4c40-bd81-5a0b9707f40a,network=Network(fe185b52-f695-4652-a43c-5794cab81101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae0a60b-29')
Nov 29 15:04:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Deleting instance files /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16_del
Nov 29 15:04:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Deletion of /opt/stack/data/nova/instances/46d6a29d-1f74-42b8-b87d-655d72921a16_del complete
Nov 29 15:04:34 user nova-compute[75215]: INFO nova.compute.manager [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 15:04:34 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:04:34 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:04:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:35 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:35 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Took 1.06 seconds to deallocate network for instance.
Nov 29 15:04:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] Acquiring lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] No waiting events found dispatching network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:36 user nova-compute[75215]: WARNING nova.compute.manager [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received unexpected event network-vif-plugged-7ae0a60b-2957-4c40-bd81-5a0b9707f40a for instance with vm_state deleted and task_state None.
Nov 29 15:04:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b7e76d0-001d-4518-8e12-2272a248cbea req-edaa4098-572a-40a7-ae88-9b3128582566 service nova] [instance: 46d6a29d-1f74-42b8-b87d-655d72921a16] Received event network-vif-deleted-7ae0a60b-2957-4c40-bd81-5a0b9707f40a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:36 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Deleted allocations for instance 46d6a29d-1f74-42b8-b87d-655d72921a16
Nov 29 15:04:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1440798-8d8b-4799-9de0-8631c7fe3dcc tempest-TestServerVolumeAttachmentScenario-462922840 tempest-TestServerVolumeAttachmentScenario-462922840-project-member] Lock "46d6a29d-1f74-42b8-b87d-655d72921a16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.779s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Going to confirm migration 2 {{(pid=75215) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquired lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:04:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'info_cache' on Instance uuid 84a68868-1bdd-46a7-b821-ee205f6e1c38 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [{"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Releasing lock "refresh_cache-84a68868-1bdd-46a7-b821-ee205f6e1c38" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'migration_context' on Instance uuid 84a68868-1bdd-46a7-b821-ee205f6e1c38 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG nova.objects.base [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Object Instance<84a68868-1bdd-46a7-b821-ee205f6e1c38> lazy-loaded attributes: info_cache,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.447s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:38 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Deleted allocation for migration a170c601-ae7c-45f6-937c-846ea82b51ad
Nov 29 15:04:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9798343a-86aa-4de5-b615-f4ae0777e8a9 tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.399s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:04:54 user nova-compute[75215]: INFO nova.compute.claims [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Claim successful on node user
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:04:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:04:54 user nova-compute[75215]: INFO nova.virt.block_device [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Booting with volume snapshot 86c19c76-ec33-414f-817e-e57047f6e5da at /dev/vda
Nov 29 15:04:54 user nova-compute[75215]: DEBUG nova.policy [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:04:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Successfully created port: b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Successfully updated port: b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-changed-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Refreshing instance network info cache due to event network-changed-b54b31d6-372d-44f4-89ae-f66b626d1f2c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] Acquiring lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] Acquired lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Refreshing network info cache for port b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b033f03-656e-4871-b9a7-ce1e6c649321 req-0e03e9bd-24e4-465c-abc1-ef7221fd9be8 service nova] Releasing lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:04:56 user nova-compute[75215]: INFO nova.compute.manager [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Unrescuing
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquired lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:04:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Updating instance_info_cache with network_info: [{"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-777ed9ae-6b36-4018-ab52-1680c2983346" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance network_info: |[{"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating instance_info_cache with network_info: [{"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Releasing lock "refresh_cache-e4a39cd7-cd54-49f6-8e92-a272fc3f043a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'flavor' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:57 user nova-compute[75215]: WARNING nova.compute.manager [req-0546c66e-4baf-44b4-89bf-12456564b7b6 req-76be36ee-b358-471c-bcdc-65dbcfcc94a6 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state rescued and task_state unrescuing.
Nov 29 15:04:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance destroyed successfully.
Nov 29 15:04:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:59 user nova-compute[75215]: WARNING nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state rescued and task_state unrescuing.
Nov 29 15:04:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:04:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:04:59 user nova-compute[75215]: WARNING nova.compute.manager [req-a3291d57-0671-475a-a1e4-2e7b4016acdc req-64f40933-655c-450c-a61b-e1e1f5d2a9be service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state rescued and task_state unrescuing.
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.utils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99521aaf-4c23-4ccb-8f9f-a86b38dfd017]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c849b9-33a5-485f-92c7-d2c3006cef5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6108dd-3311-42c2-8556-4d8ea3fcb872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5233ea12-55ea-4f82-b62e-39df39c97e4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:05:00 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:05:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c8d759-70da-4768-8df5-4289d7ebb58b]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG os_brick.utils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:05:00 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Updating existing volume attachment record: 5439e786-a329-452b-b199-f6549dd94cd5 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:05:02 user nova-compute[75215]: WARNING nova.compute.manager [req-8550cdef-0d16-4e0b-a937-7c3945803a6a req-3e9b1c52-b79c-4ffe-bbdf-a9c85afc8bd4 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state rescued and task_state unrescuing.
Nov 29 15:05:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-163770b4-5263-48a5-bbbc-add315cc96ba tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:05:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updating instance_info_cache with network_info: [{"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-6162fc1b-1263-475f-93ae-ed82d35b5c1e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:05:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:05:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:05:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:05:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:05:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Creating image(s)
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Ensure instance console log exists: /opt/stack/data/nova/instances/777ed9ae-6b36-4018-ab52-1680c2983346/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Start _get_guest_xml network_info=[{"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5439e786-a329-452b-b199-f6549dd94cd5', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMauNgLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '777ed9ae-6b36-4018-ab52-1680c2983346', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 'serial': 'f45acc95-cfa6-40ac-bbb5-fad7f010fa7e'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:05:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMauNgLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:05:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:05:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:05:08 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f199b9d-f4e9-4e99-b6b7-4b8710dd76c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:05:08 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba7b5da-8385-440e-ab2c-f8c627319110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e] added
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.193s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b672caa-fc18-448e-83ae-8e8543d6f9a5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1fdf51-f024-42b2-93eb-562a5f1f1904]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMauNgLT {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMauNgLT" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977543d-f320-469f-a5ba-ce770f94acc7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMauNgLT'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f904764a-ee2d-4f85-9d24-e7d029cb376d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3569f870-f4fc-447c-a232-6b0b1ae12581]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[81236431-f120-4083-9819-b5d5df30bb92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260]
Nov 29 15:05:08 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260] successful.
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[651c7e77-f55b-44d2-982d-203f23364f1a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef1382-3f8a-4bef-96c8-7dfc4fed7935]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:05:08 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:05:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f769ee-96d4-40bf-b814-4ba227434f75]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:05:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMauNgLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '26162633634393632', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162633634393632', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1340995868',display_name='tempest-TestVolumeBootPattern-server-1340995868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1340995868',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-h2rjzfqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:04:55Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=777ed9ae-6b36-4018-ab52-1680c2983346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid 777ed9ae-6b36-4018-ab52-1680c2983346 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:05:09 user nova-compute[75215]:   <uuid>777ed9ae-6b36-4018-ab52-1680c2983346</uuid>
Nov 29 15:05:09 user nova-compute[75215]:   <name>instance-00000026</name>
Nov 29 15:05:09 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:05:09 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:05:09 user nova-compute[75215]:   <metadata>
Nov 29 15:05:09 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:05:09 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:05:09 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-1340995868</nova:name>
Nov 29 15:05:09 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:05:08</nova:creationTime>
Nov 29 15:05:09 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:05:09 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:05:09 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:05:09 user nova-compute[75215]:       <nova:owner>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:05:09 user nova-compute[75215]:       </nova:owner>
Nov 29 15:05:09 user nova-compute[75215]:       <nova:ports>
Nov 29 15:05:09 user nova-compute[75215]:         <nova:port uuid="b54b31d6-372d-44f4-89ae-f66b626d1f2c">
Nov 29 15:05:09 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 15:05:09 user nova-compute[75215]:         </nova:port>
Nov 29 15:05:09 user nova-compute[75215]:       </nova:ports>
Nov 29 15:05:09 user nova-compute[75215]:     </nova:instance>
Nov 29 15:05:09 user nova-compute[75215]:   </metadata>
Nov 29 15:05:09 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:05:09 user nova-compute[75215]:     <system>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="serial">777ed9ae-6b36-4018-ab52-1680c2983346</entry>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="uuid">777ed9ae-6b36-4018-ab52-1680c2983346</entry>
Nov 29 15:05:09 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:05:09 user nova-compute[75215]:     </system>
Nov 29 15:05:09 user nova-compute[75215]:   </sysinfo>
Nov 29 15:05:09 user nova-compute[75215]:   <os>
Nov 29 15:05:09 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:05:09 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:05:09 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:05:09 user nova-compute[75215]:   </os>
Nov 29 15:05:09 user nova-compute[75215]:   <features>
Nov 29 15:05:09 user nova-compute[75215]:     <acpi/>
Nov 29 15:05:09 user nova-compute[75215]:     <apic/>
Nov 29 15:05:09 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:05:09 user nova-compute[75215]:   </features>
Nov 29 15:05:09 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:05:09 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:05:09 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:05:09 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:05:09 user nova-compute[75215]:   </clock>
Nov 29 15:05:09 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:05:09 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:05:09 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:05:09 user nova-compute[75215]:   </cpu>
Nov 29 15:05:09 user nova-compute[75215]:   <devices>
Nov 29 15:05:09 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:05:09 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:05:09 user nova-compute[75215]:       <source dev="/dev/sde"/>
Nov 29 15:05:09 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:05:09 user nova-compute[75215]:       <serial>f45acc95-cfa6-40ac-bbb5-fad7f010fa7e</serial>
Nov 29 15:05:09 user nova-compute[75215]:     </disk>
Nov 29 15:05:09 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:05:09 user nova-compute[75215]:       <mac address="fa:16:3e:9f:6a:f0"/>
Nov 29 15:05:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:05:09 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:05:09 user nova-compute[75215]:       <target dev="tapb54b31d6-37"/>
Nov 29 15:05:09 user nova-compute[75215]:     </interface>
Nov 29 15:05:09 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:05:09 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/777ed9ae-6b36-4018-ab52-1680c2983346/console.log" append="off"/>
Nov 29 15:05:09 user nova-compute[75215]:     </serial>
Nov 29 15:05:09 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:05:09 user nova-compute[75215]:     <video>
Nov 29 15:05:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:05:09 user nova-compute[75215]:     </video>
Nov 29 15:05:09 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:05:09 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:05:09 user nova-compute[75215]:     </rng>
Nov 29 15:05:09 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:05:09 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:05:09 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:05:09 user nova-compute[75215]:     </memballoon>
Nov 29 15:05:09 user nova-compute[75215]:   </devices>
Nov 29 15:05:09 user nova-compute[75215]: </domain>
Nov 29 15:05:09 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1340995868',display_name='tempest-TestVolumeBootPattern-server-1340995868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1340995868',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-h2rjzfqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:04:55Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=777ed9ae-6b36-4018-ab52-1680c2983346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG os_vif [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bff7fbc-3dd1-5377-8ff6-6d4a4f3499e8', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb54b31d6-37, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb54b31d6-37, col_values=(('qos', UUID('c62db5ed-5af5-449d-a649-96d8c4fcf64f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb54b31d6-37, col_values=(('external_ids', {'iface-id': 'b54b31d6-372d-44f4-89ae-f66b626d1f2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:6a:f0', 'vm-uuid': '777ed9ae-6b36-4018-ab52-1680c2983346'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:05:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:09 user nova-compute[75215]: INFO os_vif [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37')
Nov 29 15:05:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:05:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:9f:6a:f0, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] No waiting events found dispatching network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:05:11 user nova-compute[75215]: WARNING nova.compute.manager [req-ca781fcf-e5c1-4925-8654-3e66f7f74a5c req-1ab3ffd2-615c-4e3d-821a-aeb93d84c24e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received unexpected event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c for instance with vm_state building and task_state spawning.
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance spawned successfully.
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:05:13 user nova-compute[75215]: INFO nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] No waiting events found dispatching network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:05:13 user nova-compute[75215]: WARNING nova.compute.manager [req-14bc2908-e4b2-4ed6-8662-df5c44d66097 req-d37648be-ea26-401f-a219-d216150ba8d6 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received unexpected event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c for instance with vm_state building and task_state spawning.
Nov 29 15:05:13 user nova-compute[75215]: INFO nova.compute.manager [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Took 19.36 seconds to build instance.
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1d012bd-6a2f-4ae0-95b7-638b70a8de92 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.455s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:05:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:05:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:05:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8053MB free_disk=24.688419342041016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:05:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 777ed9ae-6b36-4018-ab52-1680c2983346 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:05:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:05:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:05:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:05:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:06:01 user nova-compute[75215]: INFO nova.compute.claims [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Claim successful on node user
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:06:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.policy [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3407015eced04a7f92f39617f17f6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b6902b0054023b34d2800668273c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:06:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Creating image(s)
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "/opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "/opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Successfully created port: f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Cannot resize image /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Ensure instance console log exists: /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Successfully updated port: f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquired lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-changed-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Refreshing instance network info cache due to event network-changed-f2e092b3-fb26-41c1-b867-665ef66e1d6d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] Acquiring lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:06:03 user nova-compute[75215]: INFO nova.compute.claims [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Claim successful on node user
Nov 29 15:06:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Updating instance_info_cache with network_info: [{"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Releasing lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Instance network_info: |[{"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] Acquired lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Refreshing network info cache for port f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Start _get_guest_xml network_info=[{"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:06:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1366130463',display_name='tempest-VolumesActionsTest-instance-1366130463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1366130463',id=39,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db4b6902b0054023b34d2800668273c1',ramdisk_id='',reservation_id='r-wb4zk1kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-998338116',owner_user_name='tempest-VolumesActionsTest-998338116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:06:02Z,user_data=None,user_id='3407015eced04a7f92f39617f17f6ba2',uuid=cdab42f4-6ef6-485e-9d9b-ea7c85d55347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converting VIF {"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lazy-loading 'pci_devices' on Instance uuid cdab42f4-6ef6-485e-9d9b-ea7c85d55347 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:06:04 user nova-compute[75215]:   <uuid>cdab42f4-6ef6-485e-9d9b-ea7c85d55347</uuid>
Nov 29 15:06:04 user nova-compute[75215]:   <name>instance-00000027</name>
Nov 29 15:06:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:06:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:06:04 user nova-compute[75215]:   <metadata>
Nov 29 15:06:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:06:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-1366130463</nova:name>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:06:04</nova:creationTime>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:06:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:06:04 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:owner>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:user uuid="3407015eced04a7f92f39617f17f6ba2">tempest-VolumesActionsTest-998338116-project-member</nova:user>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:project uuid="db4b6902b0054023b34d2800668273c1">tempest-VolumesActionsTest-998338116</nova:project>
Nov 29 15:06:04 user nova-compute[75215]:       </nova:owner>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:06:04 user nova-compute[75215]:       <nova:ports>
Nov 29 15:06:04 user nova-compute[75215]:         <nova:port uuid="f2e092b3-fb26-41c1-b867-665ef66e1d6d">
Nov 29 15:06:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 15:06:04 user nova-compute[75215]:         </nova:port>
Nov 29 15:06:04 user nova-compute[75215]:       </nova:ports>
Nov 29 15:06:04 user nova-compute[75215]:     </nova:instance>
Nov 29 15:06:04 user nova-compute[75215]:   </metadata>
Nov 29 15:06:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:06:04 user nova-compute[75215]:     <system>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="serial">cdab42f4-6ef6-485e-9d9b-ea7c85d55347</entry>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="uuid">cdab42f4-6ef6-485e-9d9b-ea7c85d55347</entry>
Nov 29 15:06:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:06:04 user nova-compute[75215]:     </system>
Nov 29 15:06:04 user nova-compute[75215]:   </sysinfo>
Nov 29 15:06:04 user nova-compute[75215]:   <os>
Nov 29 15:06:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:06:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:06:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:06:04 user nova-compute[75215]:   </os>
Nov 29 15:06:04 user nova-compute[75215]:   <features>
Nov 29 15:06:04 user nova-compute[75215]:     <acpi/>
Nov 29 15:06:04 user nova-compute[75215]:     <apic/>
Nov 29 15:06:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:06:04 user nova-compute[75215]:   </features>
Nov 29 15:06:04 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:06:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:06:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:06:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:06:04 user nova-compute[75215]:   </clock>
Nov 29 15:06:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:06:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:06:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:06:04 user nova-compute[75215]:   </cpu>
Nov 29 15:06:04 user nova-compute[75215]:   <devices>
Nov 29 15:06:04 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:06:04 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:06:04 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk"/>
Nov 29 15:06:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:06:04 user nova-compute[75215]:     </disk>
Nov 29 15:06:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:06:04 user nova-compute[75215]:       <mac address="fa:16:3e:3e:68:a7"/>
Nov 29 15:06:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:06:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:06:04 user nova-compute[75215]:       <target dev="tapf2e092b3-fb"/>
Nov 29 15:06:04 user nova-compute[75215]:     </interface>
Nov 29 15:06:04 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:06:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/console.log" append="off"/>
Nov 29 15:06:04 user nova-compute[75215]:     </serial>
Nov 29 15:06:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:06:04 user nova-compute[75215]:     <video>
Nov 29 15:06:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:06:04 user nova-compute[75215]:     </video>
Nov 29 15:06:04 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:06:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:06:04 user nova-compute[75215]:     </rng>
Nov 29 15:06:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:06:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:06:04 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:06:04 user nova-compute[75215]:     </memballoon>
Nov 29 15:06:04 user nova-compute[75215]:   </devices>
Nov 29 15:06:04 user nova-compute[75215]: </domain>
Nov 29 15:06:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1366130463',display_name='tempest-VolumesActionsTest-instance-1366130463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1366130463',id=39,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db4b6902b0054023b34d2800668273c1',ramdisk_id='',reservation_id='r-wb4zk1kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-998338116',owner_user_name='tempest-VolumesActionsTest-998338116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:06:02Z,user_data=None,user_id='3407015eced04a7f92f39617f17f6ba2',uuid=cdab42f4-6ef6-485e-9d9b-ea7c85d55347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converting VIF {"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_vif [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56172ed8-9887-5ea2-a7e1-4dc47210ccbf', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e092b3-fb, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e092b3-fb, col_values=(('qos', UUID('4172425e-8503-4a90-a106-24634b02afe2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e092b3-fb, col_values=(('external_ids', {'iface-id': 'f2e092b3-fb26-41c1-b867-665ef66e1d6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:68:a7', 'vm-uuid': 'cdab42f4-6ef6-485e-9d9b-ea7c85d55347'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:04 user nova-compute[75215]: INFO os_vif [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb')
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] No VIF found with MAC fa:16:3e:3e:68:a7, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:06:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:06:04 user nova-compute[75215]: INFO nova.virt.block_device [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Booting with volume f2b75bd8-a72a-4f80-bead-b2c01fd67af9 at /dev/vda
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.policy [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40d1e71e12bf4a28a73c8ed3ed310a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8de04738dc147e59f8ec5939f29780c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0aa24-51e6-4e4d-989f-420ca817414a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f928f-6276-405e-9c1b-7b4564b13906]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[892e4d13-34a2-457e-a2de-4dfc80c8869f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ca132-c19c-4425-9829-5d088170224b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Updated VIF entry in instance network info cache for port f2e092b3-fb26-41c1-b867-665ef66e1d6d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Updating instance_info_cache with network_info: [{"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:06:04 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92594cf1-0c01-4fa0-9c08-80e1eef72944]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG os_brick.utils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating existing volume attachment record: 83779c5d-abd8-4d57-9585-ee3a7412f3e8 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4950134a-53bf-4673-b9bc-c9c1ce766f1d req-ee53523e-f484-439a-aaff-0be2b5474f8a service nova] Releasing lock "refresh_cache-cdab42f4-6ef6-485e-9d9b-ea7c85d55347" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Successfully created port: febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] No waiting events found dispatching network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:06 user nova-compute[75215]: WARNING nova.compute.manager [req-9493b30a-f0f9-42f5-a94c-ff40c9af8585 req-37dc0657-ab8d-490b-ad2a-6f6672737ac3 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received unexpected event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d for instance with vm_state building and task_state spawning.
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Successfully updated port: febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:06:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance network_info: |[{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:06:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:06:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:06:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Instance spawned successfully.
Nov 29 15:06:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:08 user nova-compute[75215]: INFO nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:06:08 user nova-compute[75215]: INFO nova.compute.manager [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Took 6.21 seconds to build instance.
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a294c51-cb73-458b-997f-7ff388205d93 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing instance network info cache due to event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated VIF entry in instance network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] No waiting events found dispatching network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:08 user nova-compute[75215]: WARNING nova.compute.manager [req-089676f0-da24-47cd-b50a-21e2c90aaed0 req-ec43ecf4-e547-48da-90d3-4c5439ebf781 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received unexpected event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d for instance with vm_state active and task_state None.
Nov 29 15:06:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-changed-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Refreshing instance network info cache due to event network-changed-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] Acquiring lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] Acquired lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Refreshing network info cache for port 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Ignoring supplied device name: /dev/vdb
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updated VIF entry in instance network info cache for port 4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updating instance_info_cache with network_info: [{"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:09 user nova-compute[75215]: INFO nova.compute.manager [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Attaching volume 3799a65a-675f-46ef-976c-f804a51946e7 to /dev/vdb
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-667ab0df-51a3-4742-8382-ac8594ea21ce req-2b3aba4f-ad64-4020-bef0-81f85576ceb5 service nova] Releasing lock "refresh_cache-0bdfc35a-1f83-4fc9-8b8e-e61312246847" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG os_brick.utils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236f85f-7dca-47d8-85a0-83fdd929e9d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f420c-9fe0-4c55-8f41-998cf4d72c8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89697a4b-7021-4712-8a45-4183b0e2146e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cbf520-474d-4c34-8c76-8f436e8a5015]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:06:10 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:06:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ace28f-0062-471f-a5da-7bfacd61394c]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG os_brick.utils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:10 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updating existing volume attachment record: 9f81e232-7ed7-4cd4-8e73-5dce99895874 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:06:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Creating image(s)
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Ensure instance console log exists: /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start _get_guest_xml network_info=[{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '83779c5d-abd8-4d57-9585-ee3a7412f3e8', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e71fbe-9bb3-49b9-81a9-e8682f5d261b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'serial': 'f2b75bd8-a72a-4f80-bead-b2c01fd67af9'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:06:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:12 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f25bad-eb0b-4a77-aef3-da288837a733]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:06:12 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bc0986-cf44-4ad0-8941-3b368a550859]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9] added
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af6345-efb7-4f38-99bb-2b40d73e86da]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c99966-bd21-49c7-9c25-34cfc44f32c0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHRJslmf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHRJslmf" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0ed24-90b5-4e20-9c43-cb8610732cec]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHRJslmf'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a5cae2-f302-4aa9-9abf-ebadd84634b7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b763362-2b2e-4116-b30a-34fd2615b1f0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a2860-6a38-4d8d-8167-2cf1513133d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]
Nov 29 15:06:12 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cdb212-2585-44fa-811e-6ed231bb2cc4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db2fe95-044f-472e-9bf8-fe774e2663a0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:12 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[423771e2-8f80-4673-9371-00974f7372c1]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:06:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:06:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23333636233386638', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333636233386638', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMve0ct3DVbWEfk7DRrvm9Sx7zXsTlSjR3vlmAe2QMRSuo0hlQSqlS4QIDTJHOyvNEnjHYI7z7rAxD/NUyE5GSHhgwCczXxMDaczIXbri1gxcuCppo1GMcbRgnoLc/YKA==',key_name='tempest-TestShelveInstance-168735512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:06:05Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:06:14 user nova-compute[75215]:   <uuid>28e71fbe-9bb3-49b9-81a9-e8682f5d261b</uuid>
Nov 29 15:06:14 user nova-compute[75215]:   <name>instance-00000028</name>
Nov 29 15:06:14 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:06:14 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:06:14 user nova-compute[75215]:   <metadata>
Nov 29 15:06:14 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:06:14 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:06:14 user nova-compute[75215]:       <nova:name>tempest-TestShelveInstance-server-282916209</nova:name>
Nov 29 15:06:14 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:06:12</nova:creationTime>
Nov 29 15:06:14 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:06:14 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:06:14 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:06:14 user nova-compute[75215]:       <nova:owner>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:user uuid="40d1e71e12bf4a28a73c8ed3ed310a3d">tempest-TestShelveInstance-669488231-project-member</nova:user>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:project uuid="a8de04738dc147e59f8ec5939f29780c">tempest-TestShelveInstance-669488231</nova:project>
Nov 29 15:06:14 user nova-compute[75215]:       </nova:owner>
Nov 29 15:06:14 user nova-compute[75215]:       <nova:ports>
Nov 29 15:06:14 user nova-compute[75215]:         <nova:port uuid="febbea27-4f3b-41ea-8e47-ab6968d485db">
Nov 29 15:06:14 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 15:06:14 user nova-compute[75215]:         </nova:port>
Nov 29 15:06:14 user nova-compute[75215]:       </nova:ports>
Nov 29 15:06:14 user nova-compute[75215]:     </nova:instance>
Nov 29 15:06:14 user nova-compute[75215]:   </metadata>
Nov 29 15:06:14 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:06:14 user nova-compute[75215]:     <system>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="serial">28e71fbe-9bb3-49b9-81a9-e8682f5d261b</entry>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="uuid">28e71fbe-9bb3-49b9-81a9-e8682f5d261b</entry>
Nov 29 15:06:14 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:06:14 user nova-compute[75215]:     </system>
Nov 29 15:06:14 user nova-compute[75215]:   </sysinfo>
Nov 29 15:06:14 user nova-compute[75215]:   <os>
Nov 29 15:06:14 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:06:14 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:06:14 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:06:14 user nova-compute[75215]:   </os>
Nov 29 15:06:14 user nova-compute[75215]:   <features>
Nov 29 15:06:14 user nova-compute[75215]:     <acpi/>
Nov 29 15:06:14 user nova-compute[75215]:     <apic/>
Nov 29 15:06:14 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:06:14 user nova-compute[75215]:   </features>
Nov 29 15:06:14 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:06:14 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:06:14 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:06:14 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:06:14 user nova-compute[75215]:   </clock>
Nov 29 15:06:14 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:06:14 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:06:14 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:06:14 user nova-compute[75215]:   </cpu>
Nov 29 15:06:14 user nova-compute[75215]:   <devices>
Nov 29 15:06:14 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:06:14 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:06:14 user nova-compute[75215]:       <source dev="/dev/sdf"/>
Nov 29 15:06:14 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:06:14 user nova-compute[75215]:       <serial>f2b75bd8-a72a-4f80-bead-b2c01fd67af9</serial>
Nov 29 15:06:14 user nova-compute[75215]:     </disk>
Nov 29 15:06:14 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:06:14 user nova-compute[75215]:       <mac address="fa:16:3e:d0:22:b8"/>
Nov 29 15:06:14 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:06:14 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:06:14 user nova-compute[75215]:       <target dev="tapfebbea27-4f"/>
Nov 29 15:06:14 user nova-compute[75215]:     </interface>
Nov 29 15:06:14 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:06:14 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b/console.log" append="off"/>
Nov 29 15:06:14 user nova-compute[75215]:     </serial>
Nov 29 15:06:14 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:06:14 user nova-compute[75215]:     <video>
Nov 29 15:06:14 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:06:14 user nova-compute[75215]:     </video>
Nov 29 15:06:14 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:06:14 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:06:14 user nova-compute[75215]:     </rng>
Nov 29 15:06:14 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:06:14 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:06:14 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:06:14 user nova-compute[75215]:     </memballoon>
Nov 29 15:06:14 user nova-compute[75215]:   </devices>
Nov 29 15:06:14 user nova-compute[75215]: </domain>
Nov 29 15:06:14 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMve0ct3DVbWEfk7DRrvm9Sx7zXsTlSjR3vlmAe2QMRSuo0hlQSqlS4QIDTJHOyvNEnjHYI7z7rAxD/NUyE5GSHhgwCczXxMDaczIXbri1gxcuCppo1GMcbRgnoLc/YKA==',key_name='tempest-TestShelveInstance-168735512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:06:05Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG os_vif [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e3f878e-320b-531c-a718-9577eb6b205c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebbea27-4f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfebbea27-4f, col_values=(('qos', UUID('21116e91-cceb-4a24-96fe-40fad6af2b51')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfebbea27-4f, col_values=(('external_ids', {'iface-id': 'febbea27-4f3b-41ea-8e47-ab6968d485db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:22:b8', 'vm-uuid': '28e71fbe-9bb3-49b9-81a9-e8682f5d261b'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:14 user nova-compute[75215]: INFO os_vif [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f')
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] No VIF found with MAC fa:16:3e:d0:22:b8, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:15 user nova-compute[75215]: WARNING nova.compute.manager [req-a73bdec2-05db-4d0b-8383-0ca620587025 req-42b4e6ba-1821-4b09-a123-33cbe9f5d4ea service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state building and task_state spawning.
Nov 29 15:06:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance spawned successfully.
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:06:17 user nova-compute[75215]: INFO nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:17 user nova-compute[75215]: WARNING nova.compute.manager [req-5d7a6c9a-eac1-4076-9fad-dfa21cb9b79e req-43989a93-16bd-4f83-baff-5b7b2aea3208 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state building and task_state spawning.
Nov 29 15:06:17 user nova-compute[75215]: INFO nova.compute.manager [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Took 14.07 seconds to build instance.
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b2a1d1f0-c57d-4b4a-b5c9-51c1baa6b091 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.175s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:06:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJyMPYZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:18 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:18 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:18 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=24.67434310913086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c7448-4f32-4fce-8859-c059895c7923]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:06:18 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71ec96-7b9e-41ac-85da-0752066d894e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7] added
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[382fe718-c9c9-4cf1-ba3a-cfb7f21f79d1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bebd0f6-4094-40ec-aebc-baab350fe347]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJyMPYZk {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJyMPYZk" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f743a9-156a-407a-aad8-5d3160119b98]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJyMPYZk'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 777ed9ae-6b36-4018-ab52-1680c2983346 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance cdab42f4-6ef6-485e-9d9b-ea7c85d55347 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49d577-bb86-4078-99b5-861e26d48f72]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c595c8-1738-473e-b347-c3509462d7d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18b191-d888-4479-9aa2-e2aa5be5ab64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260]
Nov 29 15:06:18 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260] successful.
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06741ea6-f5e3-45dc-8bd7-8bfb110ed015]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b9647-e606-400a-b5ac-8b5aea973ed2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff4b57b-6c21-44a5-8402-722235499dde]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJyMPYZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:06:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23466303033323836', 'path': '/dev/sdg'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466303033323836', 'path': '/dev/sdg'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:06:19 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:06:19 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:06:19 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:06:19 user nova-compute[75215]:   <serial>3799a65a-675f-46ef-976c-f804a51946e7</serial>
Nov 29 15:06:19 user nova-compute[75215]: </disk>
Nov 29 15:06:19 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:06:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:06:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:06:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No VIF found with MAC fa:16:3e:02:51:48, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:06:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9b5a0e02-d93c-4257-80f7-b540b00e4f13 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.401s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:06:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:28 user nova-compute[75215]: INFO nova.compute.manager [None req-20fd4b46-c22c-43be-99a7-a72678a7ae9c tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Get console output
Nov 29 15:06:28 user nova-compute[75215]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 15:06:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:45 user nova-compute[75215]: INFO nova.compute.manager [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Terminating instance
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-unplugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] No waiting events found dispatching network-vif-unplugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-57e94f29-9488-46d9-9666-380fc39a3a76 req-9ef607cd-b53a-41e3-94b0-1f0c4316b36e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-unplugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Instance destroyed successfully.
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid 777ed9ae-6b36-4018-ab52-1680c2983346 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1340995868',display_name='tempest-TestVolumeBootPattern-server-1340995868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1340995868',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-h2rjzfqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:05:14Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=777ed9ae-6b36-4018-ab52-1680c2983346,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "address": "fa:16:3e:9f:6a:f0", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54b31d6-37", "ovs_interfaceid": "b54b31d6-372d-44f4-89ae-f66b626d1f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG os_vif [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:06:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb54b31d6-37, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c62db5ed-5af5-449d-a649-96d8c4fcf64f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:46 user nova-compute[75215]: INFO os_vif [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6a:f0,bridge_name='br-int',has_traffic_filtering=True,id=b54b31d6-372d-44f4-89ae-f66b626d1f2c,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54b31d6-37')
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMauNgLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:46 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a9c169-3d4a-41b5-8051-de25bdc0014b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:06:46 user nova-compute[75215]: No targets found.
Nov 29 15:06:46 user nova-compute[75215]: iSNS:
Nov 29 15:06:46 user nova-compute[75215]: No targets found.
Nov 29 15:06:46 user nova-compute[75215]: STATIC:
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:06:46 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:46 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:46 user nova-compute[75215]: FIRMWARE:
Nov 29 15:06:46 user nova-compute[75215]: No targets found.
Nov 29 15:06:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:06:46 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:06:46 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76551f-a8a5-48fa-989e-d4bc436e5331]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c00c8-a608-427b-8189-b1358153c38b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:46 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885d8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e54abe7-f16e-413b-9f0b-d7666d7cd182]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.compute.manager [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Detaching volume 3799a65a-675f-46ef-976c-f804a51946e7
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a7d28-3303-44c0-83a8-c76036761742]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ea31d-f424-4050-aee9-b456e6746249]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.virt.block_device [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Attempting to driver detach volume 3799a65a-675f-46ef-976c-f804a51946e7 from mountpoint /dev/vdb
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b22f36-dc6a-4150-8804-25e9272588a8]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a8162aa2', '/dev/disk/by-id/scsi-26162633634393632', '/dev/disk/by-id/scsi-1SCST_BIOa8162aa2-abc649629c7315e9') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:06:46 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26162633634393632
Nov 29 15:06:46 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa8162aa2-abc649629c7315e9
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe0f07-9642-4472-8448-4006ed333b01]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Attempting to detach device vdb from instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:06:46 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:06:46 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:06:46 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:06:46 user nova-compute[75215]:   <serial>3799a65a-675f-46ef-976c-f804a51946e7</serial>
Nov 29 15:06:46 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:06:46 user nova-compute[75215]: </disk>
Nov 29 15:06:46 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully detached device vdb from instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 from the persistent domain config.
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:06:46 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:06:46 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 29 15:06:46 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:06:46 user nova-compute[75215]:   <serial>3799a65a-675f-46ef-976c-f804a51946e7</serial>
Nov 29 15:06:46 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:06:46 user nova-compute[75215]: </disk>
Nov 29 15:06:46 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d16d17-3964-4216-9c10-5dce566ce139]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82817b50-b7a8-488b-9532-e514eb0738d4]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260]
Nov 29 15:06:46 user nova-compute[75215]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e, portal: 172.16.0.220,3260] successful.
Nov 29 15:06:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45acc95-cfa6-40ac-bbb5-fad7f010fa7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7969a5a-0009-4527-a998-37584b13b56c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (386ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Deleting instance files /opt/stack/data/nova/instances/777ed9ae-6b36-4018-ab52-1680c2983346_del
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Deletion of /opt/stack/data/nova/instances/777ed9ae-6b36-4018-ab52-1680c2983346_del complete
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.compute.manager [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 29 15:06:46 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Took 0.46 seconds to deallocate network for instance.
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-80230590-fdbf-4218-9c57-a3c8f1757c30 req-62d08f87-717d-49ff-b7bf-bed77face7a4 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-deleted-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:46 user nova-compute[75215]: INFO nova.compute.manager [req-80230590-fdbf-4218-9c57-a3c8f1757c30 req-62d08f87-717d-49ff-b7bf-bed77face7a4 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Neutron deleted interface b54b31d6-372d-44f4-89ae-f66b626d1f2c; detaching it from the instance and deleting it from the info cache
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-80230590-fdbf-4218-9c57-a3c8f1757c30 req-62d08f87-717d-49ff-b7bf-bed77face7a4 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-80230590-fdbf-4218-9c57-a3c8f1757c30 req-62d08f87-717d-49ff-b7bf-bed77face7a4 service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Detach interface failed, port_id=b54b31d6-372d-44f4-89ae-f66b626d1f2c, reason: Instance 777ed9ae-6b36-4018-ab52-1680c2983346 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] Acquiring lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] Lock "777ed9ae-6b36-4018-ab52-1680c2983346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] No waiting events found dispatching network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:47 user nova-compute[75215]: WARNING nova.compute.manager [req-41585d8e-a2fd-4b1d-924c-eddf2a9e7969 req-2c74fda9-abbf-47d5-b187-34b2b696b78e service nova] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Received unexpected event network-vif-plugged-b54b31d6-372d-44f4-89ae-f66b626d1f2c for instance with vm_state active and task_state deleting.
Nov 29 15:06:47 user nova-compute[75215]: INFO nova.compute.manager [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 15:06:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 777ed9ae-6b36-4018-ab52-1680c2983346] Deleting volume: f45acc95-cfa6-40ac-bbb5-fad7f010fa7e {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:48 user nova-compute[75215]: INFO nova.compute.manager [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Terminating instance
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance 777ed9ae-6b36-4018-ab52-1680c2983346
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-49675f3a-d048-463e-88c3-f4b8189dae2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "777ed9ae-6b36-4018-ab52-1680c2983346" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-15e6a2d0-e143-49da-97aa-0394bd2aee8f req-412c80dc-a818-4f7b-bc53-e8b580df1f70 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-unplugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Instance destroyed successfully.
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid e4a39cd7-cd54-49f6-8e92-a272fc3f043a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2145400785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2145400785',id=36,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-4zazwqw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:05:02Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=e4a39cd7-cd54-49f6-8e92-a272fc3f043a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "address": "fa:16:3e:a9:23:09", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f4d3fc-9d", "ovs_interfaceid": "62f4d3fc-9d76-4181-9c32-ca7a09fbeb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_vif [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62f4d3fc-9d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9580d8f9-4723-48c2-9a4f-90cd21f6da32) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:06:48 user nova-compute[75215]: INFO os_vif [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:09,bridge_name='br-int',has_traffic_filtering=True,id=62f4d3fc-9d76-4181-9c32-ca7a09fbeb73,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f4d3fc-9d')
Nov 29 15:06:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQVFGUas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:06:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d97701-e14e-4f2d-a18f-6cb1db25ef05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:06:48 user nova-compute[75215]: No targets found.
Nov 29 15:06:48 user nova-compute[75215]: iSNS:
Nov 29 15:06:48 user nova-compute[75215]: No targets found.
Nov 29 15:06:48 user nova-compute[75215]: STATIC:
Nov 29 15:06:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:06:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:48 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7
Nov 29 15:06:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:48 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:06:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:48 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:06:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:48 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e
Nov 29 15:06:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:06:48 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:06:48 user nova-compute[75215]: FIRMWARE:
Nov 29 15:06:48 user nova-compute[75215]: No targets found.
Nov 29 15:06:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:06:48 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:06:48 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:06:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85561ed0-e47f-4ef9-af79-47b15ea374a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5373d5d0-fab2-4728-a553-828df92829d1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:06:49 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:06:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885abb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e34b4-9e2c-42b7-9ec7-65309a25eac9]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[337437ac-8fa1-4325-91da-0c7983d46ed6]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[480db9a9-8053-44e5-9899-29a5de1e9f0d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc89b5-ae1b-425b-a492-322a7c2b360a]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7b24e-2433-4dbe-9dd2-1d3fa20b2dd9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8781cd4-6d3d-45ff-b09f-c986c96a6c68]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260]
Nov 29 15:06:49 user nova-compute[75215]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e, portal: 172.16.0.220,3260] successful.
Nov 29 15:06:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39033451-8732-4cbb-8410-d06b9a60e79e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c24849a-473f-4fc9-80ae-b5a6b0e3f63c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== disconnect_volume: return (344ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:06:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Deleting instance files /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a_del
Nov 29 15:06:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Deletion of /opt/stack/data/nova/instances/e4a39cd7-cd54-49f6-8e92-a272fc3f043a_del complete
Nov 29 15:06:49 user nova-compute[75215]: INFO nova.compute.manager [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 29 15:06:49 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:06:49 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:06:49 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Took 0.50 seconds to deallocate network for instance.
Nov 29 15:06:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-669f8b81-e308-4372-9e49-585348f005b0 req-3e78457b-3b7d-4f66-ae1e-7f9187940d00 service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-deleted-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] Acquiring lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] No waiting events found dispatching network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:06:50 user nova-compute[75215]: WARNING nova.compute.manager [req-bc664ca9-8bdf-463c-8654-d99e88a69736 req-f8298f05-2b04-458d-97d5-ac0b8471592f service nova] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Received unexpected event network-vif-plugged-62f4d3fc-9d76-4181-9c32-ca7a09fbeb73 for instance with vm_state active and task_state deleting.
Nov 29 15:06:50 user nova-compute[75215]: INFO nova.compute.manager [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: e4a39cd7-cd54-49f6-8e92-a272fc3f043a] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 15:06:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:06:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:06:51 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:06:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:51 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Deleted allocations for instance e4a39cd7-cd54-49f6-8e92-a272fc3f043a
Nov 29 15:06:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7f8b05be-e412-4dae-8e60-142cdd337ac7 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "e4a39cd7-cd54-49f6-8e92-a272fc3f043a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:06:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:06:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:07:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Skipping network cache update for instance because it is being deleted. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:07:06 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 is timed out.
Nov 29 15:07:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully detached device vdb from instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847 from the live domain config.
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJyMPYZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:07:06 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe92213-ead9-4c01-bd87-ad4224e9b807]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:07:06 user nova-compute[75215]: No targets found.
Nov 29 15:07:06 user nova-compute[75215]: iSNS:
Nov 29 15:07:06 user nova-compute[75215]: No targets found.
Nov 29 15:07:06 user nova-compute[75215]: STATIC:
Nov 29 15:07:06 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:07:06 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:06 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:06 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7
Nov 29 15:07:06 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:06 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:06 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:07:06 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:06 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:06 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:07:06 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:06 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:06 user nova-compute[75215]: FIRMWARE:
Nov 29 15:07:06 user nova-compute[75215]: No targets found.
Nov 29 15:07:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:07:06 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:07:06 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1a377-20d9-4d62-a699-947604b0348d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34f392-bc37-4516-b514-5b47117efebf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:07:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:06 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 (non-flash)
Nov 29 15:07:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885db880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7'): ({'sdg'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Removing single pathed devices sdg {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097d74c-6415-4310-90cf-08e1f898c8f6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [{"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98006c0c-cefb-49b7-8745-4c388026a2ff]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flushing IO for device /dev/sdg {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5808de8-e6a3-44a5-8506-1133c378db9d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6e9ab-7f9e-49ac-9425-ae85e67c5d44]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b9979-6363-4df9-b988-e7745f2adec1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc42e5b-e078-4613-9083-4216d6ee07be]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260]
Nov 29 15:07:07 user nova-compute[75215]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7, portal: 172.16.0.220,3260] successful.
Nov 29 15:07:07 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46a9802-e9b3-4799-a0d2-d902e4607656]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== disconnect_volume: return (289ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-31690efc-964a-498c-ad0a-6d3640a22de2 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.623s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:07 user nova-compute[75215]: INFO nova.compute.manager [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Terminating instance
Nov 29 15:07:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-unplugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] No waiting events found dispatching network-vif-unplugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-1bdf7b0d-691f-4c75-b2d2-be9374c2fb8f req-553254a3-b8d0-4fa8-8a7a-5dee4bf8599f service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-unplugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:07:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Instance destroyed successfully.
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'resources' on Instance uuid 0bdfc35a-1f83-4fc9-8b8e-e61312246847 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1606903681',display_name='tempest-VolumesSnapshotTestJSON-instance-1606903681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1606903681',id=37,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGp48AmO9T6kli+zTIdP/7b1CH5sjoR+aHjpgtoOlDyGhhnH8cJ433X0lGUutW30tJ3wkk/HaBT1rwqp5hlQQc+X7oQQ/q4XN8gilOpUgNsseuTRGzlyhJBrXzUknuPV3g==',key_name='tempest-keypair-1188163397',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:04:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-52ajtecp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=0bdfc35a-1f83-4fc9-8b8e-e61312246847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "address": "fa:16:3e:02:51:48", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c194e94-a4", "ovs_interfaceid": "4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_vif [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c194e94-a4, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44eb8069-ba18-49ba-8281-da9be600b256) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:08 user nova-compute[75215]: INFO os_vif [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:51:48,bridge_name='br-int',has_traffic_filtering=True,id=4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c194e94-a4')
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJyMPYZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:07:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.099s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982dc04-e5c6-4209-a24b-56d65b0eb66b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:07:08 user nova-compute[75215]: No targets found.
Nov 29 15:07:08 user nova-compute[75215]: iSNS:
Nov 29 15:07:08 user nova-compute[75215]: No targets found.
Nov 29 15:07:08 user nova-compute[75215]: STATIC:
Nov 29 15:07:08 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:07:08 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:08 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:08 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:07:08 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:08 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:08 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:07:08 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:08 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:08 user nova-compute[75215]: FIRMWARE:
Nov 29 15:07:08 user nova-compute[75215]: No targets found.
Nov 29 15:07:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:07:08 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:07:08 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3799a65a-675f-46ef-976c-f804a51946e7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e0cf8-eeb9-4fca-9a58-b27b1165da1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d2bbe-55d0-4272-94fd-63f9eb401bc9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:08 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:08 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:08 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac65f1c0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.151s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== disconnect_volume: return (151ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:07:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Deleting instance files /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847_del
Nov 29 15:07:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Deletion of /opt/stack/data/nova/instances/0bdfc35a-1f83-4fc9-8b8e-e61312246847_del complete
Nov 29 15:07:08 user nova-compute[75215]: INFO nova.compute.manager [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 15:07:08 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:07:08 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:09 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Took 0.70 seconds to deallocate network for instance.
Nov 29 15:07:09 user nova-compute[75215]: WARNING nova.volume.cinder [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Attachment 9f81e232-7ed7-4cd4-8e73-5dce99895874 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9f81e232-7ed7-4cd4-8e73-5dce99895874. (HTTP 404) (Request-ID: req-33eefee9-fd6c-4467-a688-83b2b02b928d)
Nov 29 15:07:09 user nova-compute[75215]: INFO nova.compute.manager [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Took 0.02 seconds to detach 1 volumes for instance.
Nov 29 15:07:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:10 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Deleted allocations for instance 0bdfc35a-1f83-4fc9-8b8e-e61312246847
Nov 29 15:07:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5aa09565-924d-4276-a990-ecfaf99f1d56 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] Acquiring lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] Lock "0bdfc35a-1f83-4fc9-8b8e-e61312246847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] No waiting events found dispatching network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:10 user nova-compute[75215]: WARNING nova.compute.manager [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received unexpected event network-vif-plugged-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 for instance with vm_state deleted and task_state None.
Nov 29 15:07:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-07f78cd0-68f5-488b-a1a7-9435ea0a17d8 req-6b4f0658-a6a9-4915-81a7-13b22c169778 service nova] [instance: 0bdfc35a-1f83-4fc9-8b8e-e61312246847] Received event network-vif-deleted-4c194e94-a49d-4e0b-bda7-2ac2c2d1c3c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:07:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:07:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:07:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8143MB free_disk=24.67197036743164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 84a68868-1bdd-46a7-b821-ee205f6e1c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance cdab42f4-6ef6-485e-9d9b-ea7c85d55347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:07:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:07:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:29 user nova-compute[75215]: INFO nova.compute.manager [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Terminating instance
Nov 29 15:07:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-6899f772-2069-4453-96cc-68ed8403afc1 req-75ea91e7-fb4c-4574-9315-fc286abc7031 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-unplugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Instance destroyed successfully.
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'resources' on Instance uuid 84a68868-1bdd-46a7-b821-ee205f6e1c38 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093913007',display_name='tempest-ServerActionsTestOtherA-server-1093913007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093913007',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:03:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-rp12zqc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=84a68868-1bdd-46a7-b821-ee205f6e1c38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "address": "fa:16:3e:60:4f:e9", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c82e40f-91", "ovs_interfaceid": "8c82e40f-912f-4ec7-a5b8-7ceb93c3367d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_vif [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c82e40f-91, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69d12939-ebc4-4406-9849-347e42571ed9) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:30 user nova-compute[75215]: INFO os_vif [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:4f:e9,bridge_name='br-int',has_traffic_filtering=True,id=8c82e40f-912f-4ec7-a5b8-7ceb93c3367d,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c82e40f-91')
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKjRWzPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:07:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b0459-d56c-4213-af6a-0862d25f064d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:07:30 user nova-compute[75215]: No targets found.
Nov 29 15:07:30 user nova-compute[75215]: iSNS:
Nov 29 15:07:30 user nova-compute[75215]: No targets found.
Nov 29 15:07:30 user nova-compute[75215]: STATIC:
Nov 29 15:07:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:07:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a
Nov 29 15:07:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:07:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:07:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:07:30 user nova-compute[75215]: FIRMWARE:
Nov 29 15:07:30 user nova-compute[75215]: No targets found.
Nov 29 15:07:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:07:30 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:07:30 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44900db7-208c-43c5-8455-066a2772f9a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a372b-0616-4936-8ec8-27306e3149c0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:30 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:30 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:07:30 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a (non-flash)
Nov 29 15:07:30 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:07:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3dc38-4f3a-4750-bab6-27b7669b91aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b8aaf4-c488-4ba0-879f-79f5b657d088]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d6871-33f1-49e2-b5a5-320c06207931]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[579747d3-6cdd-4fb0-b9e7-423878b87314]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23930623338366431', '/dev/disk/by-id/scsi-1SCST_BIOd356022e-90b386d125ca4d09', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d356022e') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1eac45-5661-4540-b299-9b7abfaab215]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db8464-09d6-467b-9e25-d8125a3cb71e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f6621f-30d5-41ee-95b3-80ccef094d7c]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260]
Nov 29 15:07:30 user nova-compute[75215]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a, portal: 172.16.0.220,3260] successful.
Nov 29 15:07:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eba59e4-0f5e-4f4e-91e9-0b6e705f779a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc5a571-61fc-4510-8494-c6f32930b142]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] <== disconnect_volume: return (296ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:07:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Deleting instance files /opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38_del
Nov 29 15:07:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Deletion of /opt/stack/data/nova/instances/84a68868-1bdd-46a7-b821-ee205f6e1c38_del complete
Nov 29 15:07:30 user nova-compute[75215]: INFO nova.compute.manager [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 15:07:30 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:07:30 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:07:31 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:31 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Took 0.72 seconds to deallocate network for instance.
Nov 29 15:07:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] Acquiring lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] No waiting events found dispatching network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:31 user nova-compute[75215]: WARNING nova.compute.manager [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received unexpected event network-vif-plugged-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d for instance with vm_state active and task_state deleting.
Nov 29 15:07:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef0f52d2-767e-48be-8a37-fac30a679f21 req-111f776d-4426-4c15-80a8-c18a088d0dd6 service nova] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Received event network-vif-deleted-8c82e40f-912f-4ec7-a5b8-7ceb93c3367d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:32 user nova-compute[75215]: INFO nova.compute.manager [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Took 0.93 seconds to detach 1 volumes for instance.
Nov 29 15:07:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 84a68868-1bdd-46a7-b821-ee205f6e1c38] Deleting volume: 6eba59e4-0f5e-4f4e-91e9-0b6e705f779a {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 15:07:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:32 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Deleted allocations for instance 84a68868-1bdd-46a7-b821-ee205f6e1c38
Nov 29 15:07:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c567417a-5fe8-4919-a1e2-ee24caa61d5b tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "84a68868-1bdd-46a7-b821-ee205f6e1c38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.293s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:38 user nova-compute[75215]: INFO nova.compute.manager [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Terminating instance
Nov 29 15:07:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-unplugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] No waiting events found dispatching network-vif-unplugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-db155b3d-c894-47b9-acc6-2e96a8e7207a req-46577425-0026-48dc-82b7-2a49c8067bcb service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-unplugged-d2efb058-f840-43df-8b90-c73ecb76ba17 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:07:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Instance destroyed successfully.
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid 6162fc1b-1263-475f-93ae-ed82d35b5c1e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1456921760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1456921760',id=31,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:58:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-z701s246',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:00:13Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=6162fc1b-1263-475f-93ae-ed82d35b5c1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "d2efb058-f840-43df-8b90-c73ecb76ba17", "address": "fa:16:3e:59:0e:0b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2efb058-f8", "ovs_interfaceid": "d2efb058-f840-43df-8b90-c73ecb76ba17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG os_vif [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2efb058-f8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3409b81d-9c5e-426d-8802-a0fdd8d90e2f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:39 user nova-compute[75215]: INFO os_vif [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=d2efb058-f840-43df-8b90-c73ecb76ba17,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2efb058-f8')
Nov 29 15:07:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Deleting instance files /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e_del
Nov 29 15:07:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Deletion of /opt/stack/data/nova/instances/6162fc1b-1263-475f-93ae-ed82d35b5c1e_del complete
Nov 29 15:07:39 user nova-compute[75215]: INFO nova.compute.manager [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 15:07:39 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:07:39 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:07:40 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:40 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Took 0.45 seconds to deallocate network for instance.
Nov 29 15:07:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:40 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:40 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:40 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Deleted allocations for instance 6162fc1b-1263-475f-93ae-ed82d35b5c1e
Nov 29 15:07:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43dcd44a-59bb-4fe6-8f11-bb3d29fe261c tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] Acquiring lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] Lock "6162fc1b-1263-475f-93ae-ed82d35b5c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] No waiting events found dispatching network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:41 user nova-compute[75215]: WARNING nova.compute.manager [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received unexpected event network-vif-plugged-d2efb058-f840-43df-8b90-c73ecb76ba17 for instance with vm_state deleted and task_state None.
Nov 29 15:07:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-55ebe7cb-8584-48b8-a5e7-7a5d18b295c2 req-1bfa2345-9a9d-40fd-9d64-68a6a58b68fa service nova] [instance: 6162fc1b-1263-475f-93ae-ed82d35b5c1e] Received event network-vif-deleted-d2efb058-f840-43df-8b90-c73ecb76ba17 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:07:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:07:53 user nova-compute[75215]: INFO nova.compute.claims [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Claim successful on node user
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:07:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.policy [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:07:53 user nova-compute[75215]: INFO nova.virt.block_device [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Booting with volume b6c4ac46-78d0-4c81-9333-679a158c9478 at /dev/vda
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c69eba-2f12-48f5-a99b-8d61b72bdbe0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0413ab4-a5a9-4cca-a786-d6ff8255da63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe216e34-cf80-45ce-af02-2e64a9440f34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b142cc-5cad-4102-ae4f-e87e8181fdc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:07:53 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:07:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b2e30d-0742-42a8-9a81-a4c4e7bd4ae3]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG os_brick.utils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:07:53 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating existing volume attachment record: d283b9d1-f12d-418f-bcf9-1a210e9ad24a {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:07:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Successfully created port: 35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Successfully updated port: 35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-changed-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Refreshing instance network info cache due to event network-changed-35e5677b-3d55-4f05-9f58-b1463b58a399. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] Acquiring lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:07:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating instance_info_cache with network_info: [{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Instance network_info: |[{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] Acquired lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Refreshing network info cache for port 35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing instance network info cache due to event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updated VIF entry in instance network info cache for port 35e5677b-3d55-4f05-9f58-b1463b58a399. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating instance_info_cache with network_info: [{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f6261a91-f555-44d8-8bba-4e212354eafb req-251b59a8-75f9-47de-89e4-0415297eb428 service nova] Releasing lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:07:56 user nova-compute[75215]: INFO nova.compute.claims [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Claim successful on node user
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated VIF entry in instance network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d5093b5-037a-4c85-b6a0-7111b6fc9d75 req-587db00b-70dc-4203-af80-e890480014e6 service nova] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:57 user nova-compute[75215]: INFO nova.compute.manager [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Shelve offloading
Nov 29 15:07:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:07:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.policy [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f590ceb1f6104a838b60c17b79e610c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27c9255ad994fc5b5a61fd9afa8d3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:07:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Creating image(s)
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "/opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "/opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "/opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:57 user nova-compute[75215]: WARNING nova.compute.manager [req-067f5816-2492-4255-bc5d-904e231d0727 req-c9bbfffc-aa23-457e-a563-bde6b54ed207 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state active and task_state shelving.
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance destroyed successfully.
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:07:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk 1073741824" returned: 0 in 0.058s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Cannot resize image /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Ensure instance console log exists: /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:07:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Successfully created port: 9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:07:59 user nova-compute[75215]: WARNING nova.compute.manager [req-38c0047f-9d11-475c-87d8-fa95ac7befef req-b31e030f-5bbe-4209-a032-5c8600fc2631 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state active and task_state shelving.
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:07:59 user nova-compute[75215]: INFO nova.compute.manager [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Terminating instance
Nov 29 15:07:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:07:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance destroyed successfully.
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'resources' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMve0ct3DVbWEfk7DRrvm9Sx7zXsTlSjR3vlmAe2QMRSuo0hlQSqlS4QIDTJHOyvNEnjHYI7z7rAxD/NUyE5GSHhgwCczXxMDaczIXbri1gxcuCppo1GMcbRgnoLc/YKA==',key_name='tempest-TestShelveInstance-168735512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:06:18Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_vif [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebbea27-4f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21116e91-cceb-4a24-96fe-40fad6af2b51) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: INFO os_vif [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f')
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:08:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63173f4a-e2cd-4ba4-98ce-6691f9e7a29e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:08:00 user nova-compute[75215]: No targets found.
Nov 29 15:08:00 user nova-compute[75215]: iSNS:
Nov 29 15:08:00 user nova-compute[75215]: No targets found.
Nov 29 15:08:00 user nova-compute[75215]: STATIC:
Nov 29 15:08:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:08:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:08:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:08:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:08:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:08:00 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:08:00 user nova-compute[75215]: FIRMWARE:
Nov 29 15:08:00 user nova-compute[75215]: No targets found.
Nov 29 15:08:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:08:00 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:08:00 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab4f6b2-7527-46f3-a0af-ffd8ba378555]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa32ba2-a403-46cf-a2f4-412038a89e0f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:00 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:08:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:00 user nova-compute[75215]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:08:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac79beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Successfully updated port: 9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquired lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2689ad-b524-4e0c-bec5-56f578c9db3e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c4eb3-5520-42d5-9811-7a2faa66ad61]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb15702-5bc3-46f5-92b7-b0066db42dee]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[439acd27-9aaa-4cc9-9008-85312d58e694]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b47418e-0c01-4991-a8e3-608d04dd283a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719dcf9-0f68-4b9c-9f35-23341884e035]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]
Nov 29 15:08:00 user nova-compute[75215]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.
Nov 29 15:08:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf6d66-6b9a-4022-8192-cb640852f076]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== disconnect_volume: return (314ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deleting instance files /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b_del
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deletion of /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b_del complete
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Instance destroyed successfully.
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lazy-loading 'resources' on Instance uuid cdab42f4-6ef6-485e-9d9b-ea7c85d55347 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1366130463',display_name='tempest-VolumesActionsTest-instance-1366130463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1366130463',id=39,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db4b6902b0054023b34d2800668273c1',ramdisk_id='',reservation_id='r-wb4zk1kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-998338116',owner_user_name='tempest-VolumesActionsTest-998338116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:06:08Z,user_data=None,user_id='3407015eced04a7f92f39617f17f6ba2',uuid=cdab42f4-6ef6-485e-9d9b-ea7c85d55347,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converting VIF {"id": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "address": "fa:16:3e:3e:68:a7", "network": {"id": "67afda5c-4fab-40ea-9d45-d5dfb60388e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-910797691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4b6902b0054023b34d2800668273c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e092b3-fb", "ovs_interfaceid": "f2e092b3-fb26-41c1-b867-665ef66e1d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_vif [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2e092b3-fb, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4172425e-8503-4a90-a106-24634b02afe2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:00 user nova-compute[75215]: INFO os_vif [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=f2e092b3-fb26-41c1-b867-665ef66e1d6d,network=Network(67afda5c-4fab-40ea-9d45-d5dfb60388e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e092b3-fb')
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Deleting instance files /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347_del
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Deletion of /opt/stack/data/nova/instances/cdab42f4-6ef6-485e-9d9b-ea7c85d55347_del complete
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating instance_info_cache with network_info: [{"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:00 user nova-compute[75215]: INFO nova.compute.manager [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Releasing lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Instance network_info: |[{"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Start _get_guest_xml network_info=[{"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:08:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-673717220',display_name='tempest-VolumesSnapshotTestJSON-instance-673717220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-673717220',id=42,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvl0/t5hkIlvemlQICCZOcuZbWoAFNunxw/ajhE243aZLzDVe77J+8sf4/ZkyKxnvSsdEaTl1YA2owfKSR0tGTP10nTOMo4ekDLyHvaIVXEl79nflZSbGAG4AfauCGPJA==',key_name='tempest-keypair-940075202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-a04kufqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=e981fca5-e9c8-4344-bd44-7833cab1356d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'pci_devices' on Instance uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:08:00 user nova-compute[75215]:   <uuid>e981fca5-e9c8-4344-bd44-7833cab1356d</uuid>
Nov 29 15:08:00 user nova-compute[75215]:   <name>instance-0000002a</name>
Nov 29 15:08:00 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:08:00 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:08:00 user nova-compute[75215]:   <metadata>
Nov 29 15:08:00 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:08:00 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-673717220</nova:name>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:08:00</nova:creationTime>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:08:00 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:08:00 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:owner>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:user uuid="f590ceb1f6104a838b60c17b79e610c0">tempest-VolumesSnapshotTestJSON-1046316634-project-member</nova:user>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:project uuid="f27c9255ad994fc5b5a61fd9afa8d3e6">tempest-VolumesSnapshotTestJSON-1046316634</nova:project>
Nov 29 15:08:00 user nova-compute[75215]:       </nova:owner>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:08:00 user nova-compute[75215]:       <nova:ports>
Nov 29 15:08:00 user nova-compute[75215]:         <nova:port uuid="9da1e389-5833-4046-8163-08791740ca13">
Nov 29 15:08:00 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 15:08:00 user nova-compute[75215]:         </nova:port>
Nov 29 15:08:00 user nova-compute[75215]:       </nova:ports>
Nov 29 15:08:00 user nova-compute[75215]:     </nova:instance>
Nov 29 15:08:00 user nova-compute[75215]:   </metadata>
Nov 29 15:08:00 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:08:00 user nova-compute[75215]:     <system>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="serial">e981fca5-e9c8-4344-bd44-7833cab1356d</entry>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="uuid">e981fca5-e9c8-4344-bd44-7833cab1356d</entry>
Nov 29 15:08:00 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:08:00 user nova-compute[75215]:     </system>
Nov 29 15:08:00 user nova-compute[75215]:   </sysinfo>
Nov 29 15:08:00 user nova-compute[75215]:   <os>
Nov 29 15:08:00 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:08:00 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:08:00 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:08:00 user nova-compute[75215]:   </os>
Nov 29 15:08:00 user nova-compute[75215]:   <features>
Nov 29 15:08:00 user nova-compute[75215]:     <acpi/>
Nov 29 15:08:00 user nova-compute[75215]:     <apic/>
Nov 29 15:08:00 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:08:00 user nova-compute[75215]:   </features>
Nov 29 15:08:00 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:08:00 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:08:00 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:08:00 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:08:00 user nova-compute[75215]:   </clock>
Nov 29 15:08:00 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:08:00 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:08:00 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:08:00 user nova-compute[75215]:   </cpu>
Nov 29 15:08:00 user nova-compute[75215]:   <devices>
Nov 29 15:08:00 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:08:00 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:08:00 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk"/>
Nov 29 15:08:00 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:08:00 user nova-compute[75215]:     </disk>
Nov 29 15:08:00 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:08:00 user nova-compute[75215]:       <mac address="fa:16:3e:2e:8f:ed"/>
Nov 29 15:08:00 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:08:00 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:08:00 user nova-compute[75215]:       <target dev="tap9da1e389-58"/>
Nov 29 15:08:00 user nova-compute[75215]:     </interface>
Nov 29 15:08:00 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:08:00 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/console.log" append="off"/>
Nov 29 15:08:00 user nova-compute[75215]:     </serial>
Nov 29 15:08:00 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:08:00 user nova-compute[75215]:     <video>
Nov 29 15:08:00 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:08:00 user nova-compute[75215]:     </video>
Nov 29 15:08:00 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:08:00 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:08:00 user nova-compute[75215]:     </rng>
Nov 29 15:08:00 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:08:00 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:08:00 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:08:00 user nova-compute[75215]:     </memballoon>
Nov 29 15:08:00 user nova-compute[75215]:   </devices>
Nov 29 15:08:00 user nova-compute[75215]: </domain>
Nov 29 15:08:00 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-673717220',display_name='tempest-VolumesSnapshotTestJSON-instance-673717220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-673717220',id=42,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvl0/t5hkIlvemlQICCZOcuZbWoAFNunxw/ajhE243aZLzDVe77J+8sf4/ZkyKxnvSsdEaTl1YA2owfKSR0tGTP10nTOMo4ekDLyHvaIVXEl79nflZSbGAG4AfauCGPJA==',key_name='tempest-keypair-940075202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-a04kufqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=e981fca5-e9c8-4344-bd44-7833cab1356d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG os_vif [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '400c27ba-024b-5f37-9efb-eb7a98ebb064', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9da1e389-58, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9da1e389-58, col_values=(('qos', UUID('37c9ae7e-5aa9-4eec-91a5-632648ca6a1e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9da1e389-58, col_values=(('external_ids', {'iface-id': '9da1e389-5833-4046-8163-08791740ca13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:8f:ed', 'vm-uuid': 'e981fca5-e9c8-4344-bd44-7833cab1356d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:00 user nova-compute[75215]: INFO os_vif [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58')
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:08:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No VIF found with MAC fa:16:3e:2e:8f:ed, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:01 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Took 0.57 seconds to deallocate network for instance.
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:01 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Deleted allocations for instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.053s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'numa_topology' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Object Instance<28e71fbe-9bb3-49b9-81a9-e8682f5d261b> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:08:01 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Deleted allocations for instance cdab42f4-6ef6-485e-9d9b-ea7c85d55347
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:08:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Creating image(s)
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Ensure instance console log exists: /opt/stack/data/nova/instances/1437e255-71df-4865-8863-393f79a57a00/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Start _get_guest_xml network_info=[{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd283b9d1-f12d-418f-bcf9-1a210e9ad24a', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbTqejJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1437e255-71df-4865-8863-393f79a57a00', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6c4ac46-78d0-4c81-9333-679a158c9478', 'serial': 'b6c4ac46-78d0-4c81-9333-679a158c9478'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:08:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbTqejJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:08:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:08:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:08:01 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing instance network info cache due to event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c037b-2aae-4af7-834f-dea8abca05c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:08:01 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d7a87-37a1-41a6-b0db-435002bc25d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478] added
Nov 29 15:08:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb998251-1e7f-4b39-ba32-d35d888616c4 tempest-VolumesActionsTest-998338116 tempest-VolumesActionsTest-998338116-project-member] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.032s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b2711-f1c5-4eb8-b70d-35669f69a3f2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f73996-3e11-44e5-bd13-cf4437f90208]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbTqejJH {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbTqejJH" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc87e77-7ab8-4cdd-9ef5-af03c096e79b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZbTqejJH'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab20536-0c37-4a6e-94d3-68bacbf7e76f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[90879b84-cebb-45a9-911d-26bace8c9f06]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:08:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6462e76-065e-4e0d-b175-e47d4de0e42d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260]
Nov 29 15:08:02 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260] successful.
Nov 29 15:08:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f611a65-532f-4802-9c0f-3fa57981be3a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6804f4-7fc4-47a0-afa4-0137f409670a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:02 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:08:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:02 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:08:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c922da4f-acf4-438e-8ae4-d048508d3f60 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.944s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba074b3-3aaa-4ec6-adae-8691b2a2fe7f]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbTqejJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated VIF entry in instance network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": null, "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfebbea27-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-changed-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Refreshing instance network info cache due to event network-changed-9da1e389-5833-4046-8163-08791740ca13. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquiring lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquired lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Refreshing network info cache for port 9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] No waiting events found dispatching network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1ddc8b9e-b361-4355-9507-3c9c5d9a864d req-fe494cf7-d8d1-48f5-8599-d31ad7023e8d service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received unexpected event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 for instance with vm_state building and task_state spawning.
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updated VIF entry in instance network info cache for port 9da1e389-5833-4046-8163-08791740ca13. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating instance_info_cache with network_info: [{"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Releasing lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-vif-unplugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] No waiting events found dispatching network-vif-unplugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:02 user nova-compute[75215]: WARNING nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received unexpected event network-vif-unplugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d for instance with vm_state deleted and task_state None.
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Acquiring lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] Lock "cdab42f4-6ef6-485e-9d9b-ea7c85d55347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] No waiting events found dispatching network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:02 user nova-compute[75215]: WARNING nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received unexpected event network-vif-plugged-f2e092b3-fb26-41c1-b867-665ef66e1d6d for instance with vm_state deleted and task_state None.
Nov 29 15:08:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-235d03c5-da51-4821-8c97-7550a98db45c req-69caa0cc-15ea-459b-891d-e5e11baffaa8 service nova] [instance: cdab42f4-6ef6-485e-9d9b-ea7c85d55347] Received event network-vif-deleted-f2e092b3-fb26-41c1-b867-665ef66e1d6d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26166653437386136', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166653437386136', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1918833537',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF0l4Gg/ZkYYLx++RDsLyMyYxa61kwnKnOeOvaIvX1jZFQvA9x4UaYJbeGULSrjUeK1Zo7eUPh5KBLA3IlF2QBYUZ03RRZuViupdIqGmg81xSQKok8WwXomSgFfLWmR8A==',key_name='tempest-keypair-470139118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-df9fy595',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=1437e255-71df-4865-8863-393f79a57a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid 1437e255-71df-4865-8863-393f79a57a00 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:08:03 user nova-compute[75215]:   <uuid>1437e255-71df-4865-8863-393f79a57a00</uuid>
Nov 29 15:08:03 user nova-compute[75215]:   <name>instance-00000029</name>
Nov 29 15:08:03 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:08:03 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:08:03 user nova-compute[75215]:   <metadata>
Nov 29 15:08:03 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:08:03 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:08:03 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1918833537</nova:name>
Nov 29 15:08:03 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:08:01</nova:creationTime>
Nov 29 15:08:03 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:08:03 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:08:03 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:08:03 user nova-compute[75215]:       <nova:owner>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:08:03 user nova-compute[75215]:       </nova:owner>
Nov 29 15:08:03 user nova-compute[75215]:       <nova:ports>
Nov 29 15:08:03 user nova-compute[75215]:         <nova:port uuid="35e5677b-3d55-4f05-9f58-b1463b58a399">
Nov 29 15:08:03 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 15:08:03 user nova-compute[75215]:         </nova:port>
Nov 29 15:08:03 user nova-compute[75215]:       </nova:ports>
Nov 29 15:08:03 user nova-compute[75215]:     </nova:instance>
Nov 29 15:08:03 user nova-compute[75215]:   </metadata>
Nov 29 15:08:03 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:08:03 user nova-compute[75215]:     <system>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="serial">1437e255-71df-4865-8863-393f79a57a00</entry>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="uuid">1437e255-71df-4865-8863-393f79a57a00</entry>
Nov 29 15:08:03 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:08:03 user nova-compute[75215]:     </system>
Nov 29 15:08:03 user nova-compute[75215]:   </sysinfo>
Nov 29 15:08:03 user nova-compute[75215]:   <os>
Nov 29 15:08:03 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:08:03 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:08:03 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:08:03 user nova-compute[75215]:   </os>
Nov 29 15:08:03 user nova-compute[75215]:   <features>
Nov 29 15:08:03 user nova-compute[75215]:     <acpi/>
Nov 29 15:08:03 user nova-compute[75215]:     <apic/>
Nov 29 15:08:03 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:08:03 user nova-compute[75215]:   </features>
Nov 29 15:08:03 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:08:03 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:08:03 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:08:03 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:08:03 user nova-compute[75215]:   </clock>
Nov 29 15:08:03 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:08:03 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:08:03 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:08:03 user nova-compute[75215]:   </cpu>
Nov 29 15:08:03 user nova-compute[75215]:   <devices>
Nov 29 15:08:03 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:08:03 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:08:03 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:08:03 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:08:03 user nova-compute[75215]:       <serial>b6c4ac46-78d0-4c81-9333-679a158c9478</serial>
Nov 29 15:08:03 user nova-compute[75215]:     </disk>
Nov 29 15:08:03 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:08:03 user nova-compute[75215]:       <mac address="fa:16:3e:f2:59:f5"/>
Nov 29 15:08:03 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:08:03 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:08:03 user nova-compute[75215]:       <target dev="tap35e5677b-3d"/>
Nov 29 15:08:03 user nova-compute[75215]:     </interface>
Nov 29 15:08:03 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:08:03 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/1437e255-71df-4865-8863-393f79a57a00/console.log" append="off"/>
Nov 29 15:08:03 user nova-compute[75215]:     </serial>
Nov 29 15:08:03 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:08:03 user nova-compute[75215]:     <video>
Nov 29 15:08:03 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:08:03 user nova-compute[75215]:     </video>
Nov 29 15:08:03 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:08:03 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:08:03 user nova-compute[75215]:     </rng>
Nov 29 15:08:03 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:08:03 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:08:03 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:08:03 user nova-compute[75215]:     </memballoon>
Nov 29 15:08:03 user nova-compute[75215]:   </devices>
Nov 29 15:08:03 user nova-compute[75215]: </domain>
Nov 29 15:08:03 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1918833537',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF0l4Gg/ZkYYLx++RDsLyMyYxa61kwnKnOeOvaIvX1jZFQvA9x4UaYJbeGULSrjUeK1Zo7eUPh5KBLA3IlF2QBYUZ03RRZuViupdIqGmg81xSQKok8WwXomSgFfLWmR8A==',key_name='tempest-keypair-470139118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-df9fy595',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=1437e255-71df-4865-8863-393f79a57a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG os_vif [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b5fcbd7-eb6c-5926-b07a-87aee6a3eb0a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35e5677b-3d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35e5677b-3d, col_values=(('qos', UUID('66317d77-cf4f-4b93-876f-488f8a8a91ab')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35e5677b-3d, col_values=(('external_ids', {'iface-id': '35e5677b-3d55-4f05-9f58-b1463b58a399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:59:f5', 'vm-uuid': '1437e255-71df-4865-8863-393f79a57a00'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:03 user nova-compute[75215]: INFO os_vif [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d')
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:f2:59:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:08:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:08:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Instance spawned successfully.
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:04 user nova-compute[75215]: INFO nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] No waiting events found dispatching network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:04 user nova-compute[75215]: WARNING nova.compute.manager [req-b0f22a93-c71f-4f09-b330-1ccf4594ddc2 req-087ebadb-88bc-428d-9165-f5701e673dd6 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received unexpected event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 for instance with vm_state building and task_state spawning.
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] No waiting events found dispatching network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:04 user nova-compute[75215]: WARNING nova.compute.manager [req-11ca39dc-99fe-4dff-b5de-88255a22bae6 req-0ab8eb42-122d-49ca-8c6a-64528dbafd60 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received unexpected event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 for instance with vm_state building and task_state spawning.
Nov 29 15:08:04 user nova-compute[75215]: INFO nova.compute.manager [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Took 7.84 seconds to build instance.
Nov 29 15:08:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0a86cdfd-7705-421a-a3a5-c282765b32aa tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.958s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:08:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] Instance spawned successfully.
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] No waiting events found dispatching network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:06 user nova-compute[75215]: WARNING nova.compute.manager [req-1e71c841-12c8-4228-b7df-ea7bdf6dd300 req-dabc6713-4506-49c6-be52-ba5ac13ef258 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received unexpected event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 for instance with vm_state building and task_state spawning.
Nov 29 15:08:07 user nova-compute[75215]: INFO nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 29 15:08:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:08:07 user nova-compute[75215]: INFO nova.compute.manager [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Took 14.10 seconds to build instance.
Nov 29 15:08:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5e13f02a-3a9a-4c89-a10f-71979c0b0e17 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.201s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [{"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-d4c065a7-3c11-430a-b5dc-75869210d0a9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:08:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:08:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8372MB free_disk=24.812728881835938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance ec51da57-b873-4e98-8267-e0d72c5e9097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1437e255-71df-4865-8863-393f79a57a00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e981fca5-e9c8-4344-bd44-7833cab1356d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:08:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:08:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:24 user nova-compute[75215]: INFO nova.compute.manager [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Terminating instance
Nov 29 15:08:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-unplugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] No waiting events found dispatching network-vif-unplugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-2deaee93-0a84-4e47-a722-1ef0c145253a req-e1110725-4e9b-4142-afbe-7ce6b65491bd service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-unplugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:08:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Instance destroyed successfully.
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lazy-loading 'resources' on Instance uuid 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911523263',display_name='tempest-ServerActionsTestOtherA-server-911523263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911523263',id=19,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXue3FO2s/dD6P/thZaFZdjsh6eyigpZg3XvxPiHY7oSCyQkhDe6oPVwqRbudYahgpbaZx4PX01ecFeHt0PLCZOBkyqSXFJl6wD0Dzm7iGi3iYtdW/k3SaSp/r6kzx7DQ==',key_name='tempest-keypair-1534542412',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9445b58a3554c19b57afbffbaa6a112',ramdisk_id='',reservation_id='r-fw0qotgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380950315',owner_user_name='tempest-ServerActionsTestOtherA-380950315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:49:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25bf6c00d9b340c78b2e136f22b2b211',uuid=9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converting VIF {"id": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "address": "fa:16:3e:62:12:21", "network": {"id": "c9485387-908e-4861-bbff-44c8b658f781", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821343291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9445b58a3554c19b57afbffbaa6a112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804ac5f2-69", "ovs_interfaceid": "804ac5f2-692e-4630-8e3f-59e788ba0f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG os_vif [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804ac5f2-69, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42e00ed8-6770-42cb-a650-e8917c90600b) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:25 user nova-compute[75215]: INFO os_vif [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:12:21,bridge_name='br-int',has_traffic_filtering=True,id=804ac5f2-692e-4630-8e3f-59e788ba0f28,network=Network(c9485387-908e-4861-bbff-44c8b658f781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804ac5f2-69')
Nov 29 15:08:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Deleting instance files /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3_del
Nov 29 15:08:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Deletion of /opt/stack/data/nova/instances/9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3_del complete
Nov 29 15:08:25 user nova-compute[75215]: INFO nova.compute.manager [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 15:08:25 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:25 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Took 0.52 seconds to deallocate network for instance.
Nov 29 15:08:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:08:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:08:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:26 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Deleted allocations for instance 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3
Nov 29 15:08:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e58e8026-8af2-4022-a88a-6b0886e282fd tempest-ServerActionsTestOtherA-380950315 tempest-ServerActionsTestOtherA-380950315-project-member] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.684s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] Acquiring lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] Lock "9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] No waiting events found dispatching network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:27 user nova-compute[75215]: WARNING nova.compute.manager [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received unexpected event network-vif-plugged-804ac5f2-692e-4630-8e3f-59e788ba0f28 for instance with vm_state deleted and task_state None.
Nov 29 15:08:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-1865380f-0406-464a-94c9-119ed7931295 req-2fa4678a-2c96-4c25-9f70-1d274ab71337 service nova] [instance: 9d265bb2-069a-4b1c-ac20-a2f8ee1ca4f3] Received event network-vif-deleted-804ac5f2-692e-4630-8e3f-59e788ba0f28 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:29 user nova-compute[75215]: INFO nova.compute.manager [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Terminating instance
Nov 29 15:08:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-b572c3eb-7a4f-4f6b-a3aa-1c4912279cb7 req-9926e739-4679-4a50-b027-510030c4819d service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-unplugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:08:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Instance destroyed successfully.
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid ec51da57-b873-4e98-8267-e0d72c5e9097 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-904665748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-904665748',id=24,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:54:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-0no060e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:56:28Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=ec51da57-b873-4e98-8267-e0d72c5e9097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "address": "fa:16:3e:09:0a:2b", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7cc4b-4a", "ovs_interfaceid": "dff7cc4b-4afd-49ef-86e2-c53aff50a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_vif [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff7cc4b-4a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e8902c0-592a-40e8-8c42-f89ef14a4fa7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:30 user nova-compute[75215]: INFO os_vif [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:0a:2b,bridge_name='br-int',has_traffic_filtering=True,id=dff7cc4b-4afd-49ef-86e2-c53aff50a838,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7cc4b-4a')
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVqLveGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:08:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e35abe5-8cd8-40bb-917b-2ebf8e066edb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:08:30 user nova-compute[75215]: No targets found.
Nov 29 15:08:30 user nova-compute[75215]: iSNS:
Nov 29 15:08:30 user nova-compute[75215]: No targets found.
Nov 29 15:08:30 user nova-compute[75215]: STATIC:
Nov 29 15:08:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f
Nov 29 15:08:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:08:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:08:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:08:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:08:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:08:30 user nova-compute[75215]: FIRMWARE:
Nov 29 15:08:30 user nova-compute[75215]: No targets found.
Nov 29 15:08:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:08:30 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:08:30 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc2225-1eff-4e74-88c6-8e7ea71746f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb6433-95eb-4712-bf70-c6ab4d65d4e3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:30 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:08:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f (non-flash)
Nov 29 15:08:30 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:08:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88361900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3f3548-8301-4b28-9eed-eaab31cbbd97]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c357b5-f2aa-4fe8-9107-6b450e831ed4]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14753151-7af8-420e-99b6-5ed0127d85b7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeda127-6a43-4e1b-9309-dfe8572c9a46]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd45c99-4c19-49a4-8ace-0bf0355c65d6]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf3c2e5-db6b-4262-b9c6-32d9ae610f32]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260]
Nov 29 15:08:30 user nova-compute[75215]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f, portal: 172.16.0.220,3260] successful.
Nov 29 15:08:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e683dc5b-716b-409a-9ae9-747f3a90fe0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f2d183-1ee2-4001-b045-002f221e73d9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] <== disconnect_volume: return (350ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:08:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Deleting instance files /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097_del
Nov 29 15:08:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Deletion of /opt/stack/data/nova/instances/ec51da57-b873-4e98-8267-e0d72c5e9097_del complete
Nov 29 15:08:30 user nova-compute[75215]: INFO nova.compute.manager [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 15:08:30 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:08:30 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:31 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Took 0.57 seconds to deallocate network for instance.
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-8005039b-84eb-40d8-9fb9-f396b6120a60 req-2fba28d8-59fa-47fe-95eb-d5fb8d081cc5 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-deleted-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:31 user nova-compute[75215]: INFO nova.compute.manager [req-8005039b-84eb-40d8-9fb9-f396b6120a60 req-2fba28d8-59fa-47fe-95eb-d5fb8d081cc5 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Neutron deleted interface dff7cc4b-4afd-49ef-86e2-c53aff50a838; detaching it from the instance and deleting it from the info cache
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-8005039b-84eb-40d8-9fb9-f396b6120a60 req-2fba28d8-59fa-47fe-95eb-d5fb8d081cc5 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-8005039b-84eb-40d8-9fb9-f396b6120a60 req-2fba28d8-59fa-47fe-95eb-d5fb8d081cc5 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Detach interface failed, port_id=dff7cc4b-4afd-49ef-86e2-c53aff50a838, reason: Instance ec51da57-b873-4e98-8267-e0d72c5e9097 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] Acquiring lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] No waiting events found dispatching network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:08:31 user nova-compute[75215]: WARNING nova.compute.manager [req-b7790bde-38ff-442e-90e4-8d8bbee1c379 req-7afc014c-2c53-439e-8e60-f2bba08454b8 service nova] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Received unexpected event network-vif-plugged-dff7cc4b-4afd-49ef-86e2-c53aff50a838 for instance with vm_state active and task_state deleting.
Nov 29 15:08:32 user nova-compute[75215]: INFO nova.compute.manager [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: ec51da57-b873-4e98-8267-e0d72c5e9097] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 15:08:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:08:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:08:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:08:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:08:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:32 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Deleted allocations for instance ec51da57-b873-4e98-8267-e0d72c5e9097
Nov 29 15:08:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e8003f57-8929-4291-968f-887466f8ce02 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "ec51da57-b873-4e98-8267-e0d72c5e9097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:08:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:08:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:09:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:09:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 15:09:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:09:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:09:19 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:09:19 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=24.81061553955078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d4c065a7-3c11-430a-b5dc-75869210d0a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1437e255-71df-4865-8863-393f79a57a00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e981fca5-e9c8-4344-bd44-7833cab1356d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:09:19 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:20 user nova-compute[75215]: INFO nova.compute.manager [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Terminating instance
Nov 29 15:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-unplugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] No waiting events found dispatching network-vif-unplugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-f27dfbec-dda5-4307-928a-015b20c02383 req-f7e096a9-156e-45db-b507-320974fcad0a service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-unplugged-ac720b02-bd95-40c9-b25d-55720ee908aa for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:09:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Instance destroyed successfully.
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lazy-loading 'resources' on Instance uuid d4c065a7-3c11-430a-b5dc-75869210d0a9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-390707395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-390707395',id=21,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72c331f6f384976bc971f9318b7d0b3',ramdisk_id='',reservation_id='r-agwuj6u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:51:40Z,user_data=None,user_id='0fad9c93f4ea491880e3cd7a97518367',uuid=d4c065a7-3c11-430a-b5dc-75869210d0a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converting VIF {"id": "ac720b02-bd95-40c9-b25d-55720ee908aa", "address": "fa:16:3e:a0:b0:2d", "network": {"id": "023a26e9-fd39-499c-b933-7f8a31b60085", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-449387634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72c331f6f384976bc971f9318b7d0b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac720b02-bd", "ovs_interfaceid": "ac720b02-bd95-40c9-b25d-55720ee908aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG os_vif [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac720b02-bd, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8031be95-ce80-4f10-8a6d-5109f4dde7fa) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:09:21 user nova-compute[75215]: INFO os_vif [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b0:2d,bridge_name='br-int',has_traffic_filtering=True,id=ac720b02-bd95-40c9-b25d-55720ee908aa,network=Network(023a26e9-fd39-499c-b933-7f8a31b60085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac720b02-bd')
Nov 29 15:09:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Deleting instance files /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9_del
Nov 29 15:09:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Deletion of /opt/stack/data/nova/instances/d4c065a7-3c11-430a-b5dc-75869210d0a9_del complete
Nov 29 15:09:21 user nova-compute[75215]: INFO nova.compute.manager [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 15:09:21 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:09:21 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Took 0.53 seconds to deallocate network for instance.
Nov 29 15:09:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:22 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Deleted allocations for instance d4c065a7-3c11-430a-b5dc-75869210d0a9
Nov 29 15:09:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a81af1b-4d21-4861-bc1b-d6b03f62d114 tempest-ServerBootFromVolumeStableRescueTest-1826785629 tempest-ServerBootFromVolumeStableRescueTest-1826785629-project-member] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] Acquiring lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] Lock "d4c065a7-3c11-430a-b5dc-75869210d0a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] No waiting events found dispatching network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:09:22 user nova-compute[75215]: WARNING nova.compute.manager [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received unexpected event network-vif-plugged-ac720b02-bd95-40c9-b25d-55720ee908aa for instance with vm_state deleted and task_state None.
Nov 29 15:09:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-319f5967-4f3d-45af-8847-5cfa3a46b09a req-d242c15b-7d6f-44a3-b9ec-fd495ad50cfa service nova] [instance: d4c065a7-3c11-430a-b5dc-75869210d0a9] Received event network-vif-deleted-ac720b02-bd95-40c9-b25d-55720ee908aa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:09:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-changed-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Refreshing instance network info cache due to event network-changed-35e5677b-3d55-4f05-9f58-b1463b58a399. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] Acquiring lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] Acquired lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Refreshing network info cache for port 35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updated VIF entry in instance network info cache for port 35e5677b-3d55-4f05-9f58-b1463b58a399. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating instance_info_cache with network_info: [{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:09:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d8506364-954f-44b6-b6a5-feb461b4ebe5 req-c60c5d97-3e5b-43c9-8cb0-f6db5d8a2a1c service nova] Releasing lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:09:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-changed-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Refreshing instance network info cache due to event network-changed-9da1e389-5833-4046-8163-08791740ca13. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] Acquiring lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] Acquired lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Refreshing network info cache for port 9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:09:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Ignoring supplied device name: /dev/vdb
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:48 user nova-compute[75215]: INFO nova.compute.manager [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Attaching volume 84009450-5665-4136-8c73-3e5b83f4f8bb to /dev/vdb
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06dc243-0973-4bef-8fdb-26601eeb3d47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9a7a4-6f56-468b-bf5b-ff0ea1256dca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updated VIF entry in instance network info cache for port 9da1e389-5833-4046-8163-08791740ca13. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating instance_info_cache with network_info: [{"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38445b-bbc9-4bdf-8332-d07afce42bdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd9c53c-3cde-4868-ab4a-26d157994ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce3b0760-311b-452a-9b56-8e88a0aa85e9 req-2f1b059e-d7a2-4fa2-9065-cc089e1a3b83 service nova] Releasing lock "refresh_cache-e981fca5-e9c8-4344-bd44-7833cab1356d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:48 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dc7cb2-be5f-47d7-9683-8c928a0bf6d5]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating existing volume attachment record: 3dc9724b-2c20-4afb-a170-c2e02a47a03c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:48 user nova-compute[75215]: INFO nova.compute.manager [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Unshelving
Nov 29 15:09:48 user nova-compute[75215]: INFO nova.virt.block_device [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Booting with volume f2b75bd8-a72a-4f80-bead-b2c01fd67af9 at /dev/vda
Nov 29 15:09:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.utils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63283fd-912e-4c82-a143-13397105f136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7055f672-c1be-43c6-bdf7-e321820b546a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae958cc-3349-4dcd-a3c0-852362fd00e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc48ac1-d018-40fb-b384-d9d5bff24b40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:49 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:09:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2af524-2284-4ec8-966e-9ac3593751f4]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG os_brick.utils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:09:49 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating existing volume attachment record: 0a3e3815-52e8-4707-9219-193e773ae7af {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:09:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:09:53 user nova-compute[75215]: INFO nova.compute.claims [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Claim successful on node user
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:09:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:09:53 user nova-compute[75215]: INFO nova.virt.block_device [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Booting with volume snapshot 22b267be-ff69-407b-bbfd-f04f4b2cae56 at /dev/vda
Nov 29 15:09:53 user nova-compute[75215]: DEBUG nova.policy [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:09:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Successfully created port: bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Successfully updated port: bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-changed-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Refreshing instance network info cache due to event network-changed-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:09:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] Acquiring lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updating instance_info_cache with network_info: [{"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Instance network_info: |[{"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] Acquired lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Refreshing network info cache for port bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updated VIF entry in instance network info cache for port bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updating instance_info_cache with network_info: [{"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:09:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-86ed4011-f64c-41be-a864-fd7004dd1d60 req-d6843eb6-35cb-42fe-b0de-dfa35fcf0773 service nova] Releasing lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxFveZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:09:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:09:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:09:57 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8aa75-03f0-414a-bd99-4f9f3cf7e5ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:09:57 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bfb1cb-fe4c-4827-a928-87b9574d1063]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb] added
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475c608-f6b1-4b90-a4a0-8dc08138ce6d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c369d56-c4ca-415c-8cdf-c454b411bece]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxFveZPC {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxFveZPC" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2802a9a-6800-40a5-aeeb-2d8c17bf7dd2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qxFveZPC'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19578ae1-9ad0-4cec-ba9b-7be801129ba9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c12ba-76e1-43ae-aa9a-175f3929453a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02db3ab-283f-4a0f-a95a-59a1c6aaabce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260]
Nov 29 15:09:57 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260] successful.
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c55779e-cc24-4e90-a1fb-226d785344b3]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[668a908a-79d1-40a8-893f-1822996b111b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:09:57 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:09:57 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:09:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c3e3a8-0b2a-4c99-aa27-355806feb2d0]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:09:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxFveZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'pci_requests' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'numa_topology' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:09:58 user nova-compute[75215]: INFO nova.compute.claims [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Claim successful on node user
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26633646565353433', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646565353433', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:09:58 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:09:58 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:09:58 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:09:58 user nova-compute[75215]:   <serial>84009450-5665-4136-8c73-3e5b83f4f8bb</serial>
Nov 29 15:09:58 user nova-compute[75215]: </disk>
Nov 29 15:09:58 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:09:58 user nova-compute[75215]: INFO nova.network.neutron [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating port febbea27-4f3b-41ea-8e47-ab6968d485db with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:09:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] No VIF found with MAC fa:16:3e:2e:8f:ed, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7031b7ab-6910-47f9-9580-8d02291bebd4 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.485s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12c3933-9caf-4f6b-9ddb-dae4e4c082c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6aec9-63c1-4844-84cf-49db5c10afe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5db361-f5ea-44e6-a996-eda3cc088589]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec49ed-3ccc-403d-81d4-91c50dde462d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:09:59 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c352d-06f1-440d-afc0-2c500418a106]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing instance network info cache due to event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:09:59 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updating existing volume attachment record: b277dcef-8297-48f7-b022-22b513a66717 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:10:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Creating image(s)
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Ensure instance console log exists: /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start _get_guest_xml network_info=[{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0a3e3815-52e8-4707-9219-193e773ae7af', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e71fbe-9bb3-49b9-81a9-e8682f5d261b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'serial': 'f2b75bd8-a72a-4f80-bead-b2c01fd67af9'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:10:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.objects.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Object Instance<28e71fbe-9bb3-49b9-81a9-e8682f5d261b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:10:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:00 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563117d-4694-4e3d-984e-d91147eaa14f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:10:00 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270855f-33b7-4e66-9263-b572e118a0d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9] added
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa2fdc-ce9b-4266-a7c5-eed5cf56dc86]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5554b5-0b46-496a-845e-1007bcf7d082]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHRJslmf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHRJslmf" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706edc5-1e56-4fb0-9fd9-908971c825ff]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHRJslmf'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[be857a3e-1bb2-4a74-80e1-9d3adf2a0cf8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b78b7c-4ef4-4302-8528-6fdd2a7b6059]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded9510-09a2-4e4a-b50a-64dda5bd1d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]
Nov 29 15:10:00 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecffd68-affe-4168-abff-8a56b71f3f0a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc18572-fe26-4554-b1f9-da81fdbda64c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:00 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe03c1b3-4baa-4a04-8ee7-fe3a721b074c]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated VIF entry in instance network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-145ad898-2bfb-4354-aa74-a1e65bd86f8b req-3a7049c3-fe9b-4d14-ae7e-517ef6ed5047 service nova] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23333636233386638', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333636233386638', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-168735512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:09:49Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Object Instance<28e71fbe-9bb3-49b9-81a9-e8682f5d261b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:10:01 user nova-compute[75215]:   <uuid>28e71fbe-9bb3-49b9-81a9-e8682f5d261b</uuid>
Nov 29 15:10:01 user nova-compute[75215]:   <name>instance-00000028</name>
Nov 29 15:10:01 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:10:01 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:10:01 user nova-compute[75215]:   <metadata>
Nov 29 15:10:01 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:10:01 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:10:01 user nova-compute[75215]:       <nova:name>tempest-TestShelveInstance-server-282916209</nova:name>
Nov 29 15:10:01 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:10:00</nova:creationTime>
Nov 29 15:10:01 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:10:01 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:10:01 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:10:01 user nova-compute[75215]:       <nova:owner>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:user uuid="40d1e71e12bf4a28a73c8ed3ed310a3d">tempest-TestShelveInstance-669488231-project-member</nova:user>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:project uuid="a8de04738dc147e59f8ec5939f29780c">tempest-TestShelveInstance-669488231</nova:project>
Nov 29 15:10:01 user nova-compute[75215]:       </nova:owner>
Nov 29 15:10:01 user nova-compute[75215]:       <nova:ports>
Nov 29 15:10:01 user nova-compute[75215]:         <nova:port uuid="febbea27-4f3b-41ea-8e47-ab6968d485db">
Nov 29 15:10:01 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 15:10:01 user nova-compute[75215]:         </nova:port>
Nov 29 15:10:01 user nova-compute[75215]:       </nova:ports>
Nov 29 15:10:01 user nova-compute[75215]:     </nova:instance>
Nov 29 15:10:01 user nova-compute[75215]:   </metadata>
Nov 29 15:10:01 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:10:01 user nova-compute[75215]:     <system>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="serial">28e71fbe-9bb3-49b9-81a9-e8682f5d261b</entry>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="uuid">28e71fbe-9bb3-49b9-81a9-e8682f5d261b</entry>
Nov 29 15:10:01 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:10:01 user nova-compute[75215]:     </system>
Nov 29 15:10:01 user nova-compute[75215]:   </sysinfo>
Nov 29 15:10:01 user nova-compute[75215]:   <os>
Nov 29 15:10:01 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:10:01 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:10:01 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:10:01 user nova-compute[75215]:   </os>
Nov 29 15:10:01 user nova-compute[75215]:   <features>
Nov 29 15:10:01 user nova-compute[75215]:     <acpi/>
Nov 29 15:10:01 user nova-compute[75215]:     <apic/>
Nov 29 15:10:01 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:10:01 user nova-compute[75215]:   </features>
Nov 29 15:10:01 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:10:01 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:10:01 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:10:01 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:10:01 user nova-compute[75215]:   </clock>
Nov 29 15:10:01 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:10:01 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:10:01 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:10:01 user nova-compute[75215]:   </cpu>
Nov 29 15:10:01 user nova-compute[75215]:   <devices>
Nov 29 15:10:01 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:10:01 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:10:01 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 15:10:01 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:10:01 user nova-compute[75215]:       <serial>f2b75bd8-a72a-4f80-bead-b2c01fd67af9</serial>
Nov 29 15:10:01 user nova-compute[75215]:     </disk>
Nov 29 15:10:01 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:10:01 user nova-compute[75215]:       <mac address="fa:16:3e:d0:22:b8"/>
Nov 29 15:10:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:01 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:10:01 user nova-compute[75215]:       <target dev="tapfebbea27-4f"/>
Nov 29 15:10:01 user nova-compute[75215]:     </interface>
Nov 29 15:10:01 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:10:01 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b/console.log" append="off"/>
Nov 29 15:10:01 user nova-compute[75215]:     </serial>
Nov 29 15:10:01 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:10:01 user nova-compute[75215]:     <video>
Nov 29 15:10:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:01 user nova-compute[75215]:     </video>
Nov 29 15:10:01 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:10:01 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:10:01 user nova-compute[75215]:     </rng>
Nov 29 15:10:01 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:10:01 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:10:01 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:10:01 user nova-compute[75215]:     </memballoon>
Nov 29 15:10:01 user nova-compute[75215]:   </devices>
Nov 29 15:10:01 user nova-compute[75215]: </domain>
Nov 29 15:10:01 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-168735512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:09:49Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG os_vif [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e3f878e-320b-531c-a718-9577eb6b205c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebbea27-4f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfebbea27-4f, col_values=(('qos', UUID('d7f72edd-309f-4c85-979e-3ac71928832a')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfebbea27-4f, col_values=(('external_ids', {'iface-id': 'febbea27-4f3b-41ea-8e47-ab6968d485db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:22:b8', 'vm-uuid': '28e71fbe-9bb3-49b9-81a9-e8682f5d261b'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:01 user nova-compute[75215]: INFO os_vif [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f')
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:10:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] No VIF found with MAC fa:16:3e:d0:22:b8, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:03 user nova-compute[75215]: WARNING nova.compute.manager [req-365fed7b-4e57-4f20-9265-93e52f070d6b req-d775747c-97f8-4371-bbc3-4c17fd41b10e service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 15:10:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:10:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance spawned successfully.
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-36f58270-babc-4536-b162-a8623ac22ee9 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.542s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:05 user nova-compute[75215]: WARNING nova.compute.manager [req-e617f47d-974d-4246-913c-26573ba0b463 req-100d8c60-66c0-4019-a6eb-93ac69ec8e97 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state active and task_state None.
Nov 29 15:10:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:10:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:10:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Creating image(s)
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Ensure instance console log exists: /opt/stack/data/nova/instances/d78b4793-3fd9-42dc-9c5d-5b93c11c47d9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Start _get_guest_xml network_info=[{"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T15:09:46Z,direct_url=<?>,disk_format='qcow2',id=e2dad8b3-3210-4f1f-b136-fa38868e031d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-303548482',owner='5732bef6e1c44fcab9ef85f5e9a0572b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T15:09:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b277dcef-8297-48f7-b022-22b513a66717', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmAVDxOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd78b4793-3fd9-42dc-9c5d-5b93c11c47d9', 'attached_at': '', 'detached_at': '', 'volume_id': '3a802bd0-4129-466f-9657-fbcf9ebc47d7', 'serial': '3a802bd0-4129-466f-9657-fbcf9ebc47d7'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:10:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T15:09:46Z,direct_url=<?>,disk_format='qcow2',id=e2dad8b3-3210-4f1f-b136-fa38868e031d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-303548482',owner='5732bef6e1c44fcab9ef85f5e9a0572b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T15:09:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmAVDxOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:10:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:08 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ecb213-cf62-48e2-aa1b-f826d724719c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:10:08 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9283ce1-4f67-41a2-86c3-daa8885c2e69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7] added
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047d1c4-cf41-4ef3-bea0-7c2d58779be4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.062s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf15b0-b2db-4118-ad4e-49f35f90164b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmAVDxOh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmAVDxOh" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26259b-e4b9-4d36-a968-9fee3581a0db]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZmAVDxOh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7329107-cdd5-42cc-b64b-3eddb55900fa]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6becc64-081d-41b8-a4c7-4babc043113d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaedd94e-bd9a-4402-af1e-3e8b233abca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260]
Nov 29 15:10:08 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260] successful.
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253b2f0-2709-4704-980d-fb02c563443b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[061b625b-d124-4632-8808-d06241a81e44]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d265ab73-d4ca-490a-9612-f61c935bdfc4]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:10:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmAVDxOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26131653434336336', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131653434336336', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-72905601',id=43,image_ref='e2dad8b3-3210-4f1f-b136-fa38868e031d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHFgG8vyiwcJRXeqps293kfgjqmyQjmMVUyjSz8bcALTKLDJ7c7TKR2GBKJ8CbI6XFWdEUue0e/ESgULYUefnS+b9s5aVeJMXNmd0xEvpevufJ7s9q9KZiZCVxP94aIkA==',key_name='tempest-keypair-755574447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-dywrukn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-288309841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=d78b4793-3fd9-42dc-9c5d-5b93c11c47d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid d78b4793-3fd9-42dc-9c5d-5b93c11c47d9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:10:09 user nova-compute[75215]:   <uuid>d78b4793-3fd9-42dc-9c5d-5b93c11c47d9</uuid>
Nov 29 15:10:09 user nova-compute[75215]:   <name>instance-0000002b</name>
Nov 29 15:10:09 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:10:09 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:10:09 user nova-compute[75215]:   <metadata>
Nov 29 15:10:09 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:10:09 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-72905601</nova:name>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:10:08</nova:creationTime>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:10:09 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:10:09 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:owner>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:10:09 user nova-compute[75215]:       </nova:owner>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:root type="image" uuid="e2dad8b3-3210-4f1f-b136-fa38868e031d"/>
Nov 29 15:10:09 user nova-compute[75215]:       <nova:ports>
Nov 29 15:10:09 user nova-compute[75215]:         <nova:port uuid="bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac">
Nov 29 15:10:09 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 15:10:09 user nova-compute[75215]:         </nova:port>
Nov 29 15:10:09 user nova-compute[75215]:       </nova:ports>
Nov 29 15:10:09 user nova-compute[75215]:     </nova:instance>
Nov 29 15:10:09 user nova-compute[75215]:   </metadata>
Nov 29 15:10:09 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:10:09 user nova-compute[75215]:     <system>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="serial">d78b4793-3fd9-42dc-9c5d-5b93c11c47d9</entry>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="uuid">d78b4793-3fd9-42dc-9c5d-5b93c11c47d9</entry>
Nov 29 15:10:09 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:10:09 user nova-compute[75215]:     </system>
Nov 29 15:10:09 user nova-compute[75215]:   </sysinfo>
Nov 29 15:10:09 user nova-compute[75215]:   <os>
Nov 29 15:10:09 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:10:09 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:10:09 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:10:09 user nova-compute[75215]:   </os>
Nov 29 15:10:09 user nova-compute[75215]:   <features>
Nov 29 15:10:09 user nova-compute[75215]:     <acpi/>
Nov 29 15:10:09 user nova-compute[75215]:     <apic/>
Nov 29 15:10:09 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:10:09 user nova-compute[75215]:   </features>
Nov 29 15:10:09 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:10:09 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:10:09 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:10:09 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:10:09 user nova-compute[75215]:   </clock>
Nov 29 15:10:09 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:10:09 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:10:09 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:10:09 user nova-compute[75215]:   </cpu>
Nov 29 15:10:09 user nova-compute[75215]:   <devices>
Nov 29 15:10:09 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:10:09 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:10:09 user nova-compute[75215]:       <source dev="/dev/sde"/>
Nov 29 15:10:09 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:10:09 user nova-compute[75215]:       <serial>3a802bd0-4129-466f-9657-fbcf9ebc47d7</serial>
Nov 29 15:10:09 user nova-compute[75215]:     </disk>
Nov 29 15:10:09 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:10:09 user nova-compute[75215]:       <mac address="fa:16:3e:dc:bb:ef"/>
Nov 29 15:10:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:09 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:10:09 user nova-compute[75215]:       <target dev="tapbcf6f7f9-49"/>
Nov 29 15:10:09 user nova-compute[75215]:     </interface>
Nov 29 15:10:09 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:10:09 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d78b4793-3fd9-42dc-9c5d-5b93c11c47d9/console.log" append="off"/>
Nov 29 15:10:09 user nova-compute[75215]:     </serial>
Nov 29 15:10:09 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:10:09 user nova-compute[75215]:     <video>
Nov 29 15:10:09 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:09 user nova-compute[75215]:     </video>
Nov 29 15:10:09 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:10:09 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:10:09 user nova-compute[75215]:     </rng>
Nov 29 15:10:09 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:10:09 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:10:09 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:10:09 user nova-compute[75215]:     </memballoon>
Nov 29 15:10:09 user nova-compute[75215]:   </devices>
Nov 29 15:10:09 user nova-compute[75215]: </domain>
Nov 29 15:10:09 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-72905601',id=43,image_ref='e2dad8b3-3210-4f1f-b136-fa38868e031d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHFgG8vyiwcJRXeqps293kfgjqmyQjmMVUyjSz8bcALTKLDJ7c7TKR2GBKJ8CbI6XFWdEUue0e/ESgULYUefnS+b9s5aVeJMXNmd0xEvpevufJ7s9q9KZiZCVxP94aIkA==',key_name='tempest-keypair-755574447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-dywrukn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-288309841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=d78b4793-3fd9-42dc-9c5d-5b93c11c47d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG os_vif [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '909e2c79-3523-52a0-87b0-7aceeb537f5e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcf6f7f9-49, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcf6f7f9-49, col_values=(('qos', UUID('894b1470-3add-44d0-86b4-b71086a20478')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcf6f7f9-49, col_values=(('external_ids', {'iface-id': 'bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:bb:ef', 'vm-uuid': 'd78b4793-3fd9-42dc-9c5d-5b93c11c47d9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:09 user nova-compute[75215]: INFO os_vif [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49')
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:10:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:dc:bb:ef, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] No waiting events found dispatching network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:11 user nova-compute[75215]: WARNING nova.compute.manager [req-a84179a3-2b64-4522-a8f6-88937fa16200 req-a8f5a8c5-a59d-403d-bd33-c06a6653ed94 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received unexpected event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac for instance with vm_state building and task_state spawning.
Nov 29 15:10:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:10:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Instance spawned successfully.
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] No waiting events found dispatching network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:13 user nova-compute[75215]: WARNING nova.compute.manager [req-ab01548a-64b3-4579-b26c-50211be717d1 req-1edfe4b4-bad1-4a98-b184-2f8da7d559a7 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received unexpected event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac for instance with vm_state building and task_state spawning.
Nov 29 15:10:13 user nova-compute[75215]: INFO nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 29 15:10:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:10:13 user nova-compute[75215]: INFO nova.compute.manager [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Took 20.43 seconds to build instance.
Nov 29 15:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10d65e52-fcc7-4c06-9ac9-a9a2283d85d8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.549s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:10:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 1437e255-71df-4865-8863-393f79a57a00 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid d78b4793-3fd9-42dc-9c5d-5b93c11c47d9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "1437e255-71df-4865-8863-393f79a57a00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "1437e255-71df-4865-8863-393f79a57a00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:10:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:10:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.913414001464844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1437e255-71df-4865-8863-393f79a57a00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance e981fca5-e9c8-4344-bd44-7833cab1356d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d78b4793-3fd9-42dc-9c5d-5b93c11c47d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:10:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:21 user nova-compute[75215]: INFO nova.compute.manager [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Detaching volume 84009450-5665-4136-8c73-3e5b83f4f8bb
Nov 29 15:10:21 user nova-compute[75215]: INFO nova.virt.block_device [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Attempting to driver detach volume 84009450-5665-4136-8c73-3e5b83f4f8bb from mountpoint /dev/vdb
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Attempting to detach device vdb from instance e981fca5-e9c8-4344-bd44-7833cab1356d from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:10:21 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:10:21 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:10:21 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:10:21 user nova-compute[75215]:   <serial>84009450-5665-4136-8c73-3e5b83f4f8bb</serial>
Nov 29 15:10:21 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:10:21 user nova-compute[75215]: </disk>
Nov 29 15:10:21 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:10:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully detached device vdb from instance e981fca5-e9c8-4344-bd44-7833cab1356d from the persistent domain config.
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e981fca5-e9c8-4344-bd44-7833cab1356d from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:10:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:10:21 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:10:21 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:10:21 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:10:21 user nova-compute[75215]:   <serial>84009450-5665-4136-8c73-3e5b83f4f8bb</serial>
Nov 29 15:10:21 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:10:21 user nova-compute[75215]: </disk>
Nov 29 15:10:21 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:10:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:10:23 user nova-compute[75215]: INFO nova.compute.claims [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Claim successful on node user
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:10:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:10:23 user nova-compute[75215]: DEBUG nova.policy [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3b87f40b5f943debc89110626be29e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd655981e000d4997aa5db8bc1d79dc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:10:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Creating image(s)
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "/opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "/opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "/opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk 1073741824" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Successfully created port: e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:10:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Cannot resize image /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Successfully updated port: e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquired lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-changed-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Refreshing instance network info cache due to event network-changed-e7f3339d-fbff-4a5e-9907-b93df1e452de. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] Acquiring lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Releasing lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Instance network_info: |[{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] Acquired lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Refreshing network info cache for port e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Start _get_guest_xml network_info=[{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:10:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727154754',display_name='tempest-ServersNegativeTestJSON-server-1727154754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727154754',id=44,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-niui3ihg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:10:24Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=36917fd7-1fb8-463b-95e9-affd4a46d3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lazy-loading 'pci_devices' on Instance uuid 36917fd7-1fb8-463b-95e9-affd4a46d3c4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:10:25 user nova-compute[75215]:   <uuid>36917fd7-1fb8-463b-95e9-affd4a46d3c4</uuid>
Nov 29 15:10:25 user nova-compute[75215]:   <name>instance-0000002c</name>
Nov 29 15:10:25 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:10:25 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:10:25 user nova-compute[75215]:   <metadata>
Nov 29 15:10:25 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:10:25 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:name>tempest-ServersNegativeTestJSON-server-1727154754</nova:name>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:10:25</nova:creationTime>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:10:25 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:10:25 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:owner>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:user uuid="e3b87f40b5f943debc89110626be29e3">tempest-ServersNegativeTestJSON-1652934373-project-member</nova:user>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:project uuid="d655981e000d4997aa5db8bc1d79dc5d">tempest-ServersNegativeTestJSON-1652934373</nova:project>
Nov 29 15:10:25 user nova-compute[75215]:       </nova:owner>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:10:25 user nova-compute[75215]:       <nova:ports>
Nov 29 15:10:25 user nova-compute[75215]:         <nova:port uuid="e7f3339d-fbff-4a5e-9907-b93df1e452de">
Nov 29 15:10:25 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 15:10:25 user nova-compute[75215]:         </nova:port>
Nov 29 15:10:25 user nova-compute[75215]:       </nova:ports>
Nov 29 15:10:25 user nova-compute[75215]:     </nova:instance>
Nov 29 15:10:25 user nova-compute[75215]:   </metadata>
Nov 29 15:10:25 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:10:25 user nova-compute[75215]:     <system>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="serial">36917fd7-1fb8-463b-95e9-affd4a46d3c4</entry>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="uuid">36917fd7-1fb8-463b-95e9-affd4a46d3c4</entry>
Nov 29 15:10:25 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:10:25 user nova-compute[75215]:     </system>
Nov 29 15:10:25 user nova-compute[75215]:   </sysinfo>
Nov 29 15:10:25 user nova-compute[75215]:   <os>
Nov 29 15:10:25 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:10:25 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:10:25 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:10:25 user nova-compute[75215]:   </os>
Nov 29 15:10:25 user nova-compute[75215]:   <features>
Nov 29 15:10:25 user nova-compute[75215]:     <acpi/>
Nov 29 15:10:25 user nova-compute[75215]:     <apic/>
Nov 29 15:10:25 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:10:25 user nova-compute[75215]:   </features>
Nov 29 15:10:25 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:10:25 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:10:25 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:10:25 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:10:25 user nova-compute[75215]:   </clock>
Nov 29 15:10:25 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:10:25 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:10:25 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:10:25 user nova-compute[75215]:   </cpu>
Nov 29 15:10:25 user nova-compute[75215]:   <devices>
Nov 29 15:10:25 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:10:25 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:10:25 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk"/>
Nov 29 15:10:25 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:10:25 user nova-compute[75215]:     </disk>
Nov 29 15:10:25 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:10:25 user nova-compute[75215]:       <mac address="fa:16:3e:4f:3c:65"/>
Nov 29 15:10:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:25 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:10:25 user nova-compute[75215]:       <target dev="tape7f3339d-fb"/>
Nov 29 15:10:25 user nova-compute[75215]:     </interface>
Nov 29 15:10:25 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:10:25 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/console.log" append="off"/>
Nov 29 15:10:25 user nova-compute[75215]:     </serial>
Nov 29 15:10:25 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:10:25 user nova-compute[75215]:     <video>
Nov 29 15:10:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:10:25 user nova-compute[75215]:     </video>
Nov 29 15:10:25 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:10:25 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:10:25 user nova-compute[75215]:     </rng>
Nov 29 15:10:25 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:10:25 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:10:25 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:10:25 user nova-compute[75215]:     </memballoon>
Nov 29 15:10:25 user nova-compute[75215]:   </devices>
Nov 29 15:10:25 user nova-compute[75215]: </domain>
Nov 29 15:10:25 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727154754',display_name='tempest-ServersNegativeTestJSON-server-1727154754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727154754',id=44,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-niui3ihg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:10:24Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=36917fd7-1fb8-463b-95e9-affd4a46d3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG os_vif [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba94e23e-074f-57de-ac8f-0d251585da3f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f3339d-fb, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7f3339d-fb, col_values=(('qos', UUID('b0118b8c-3841-48fd-b4e5-5562080df8ef')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7f3339d-fb, col_values=(('external_ids', {'iface-id': 'e7f3339d-fbff-4a5e-9907-b93df1e452de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:3c:65', 'vm-uuid': '36917fd7-1fb8-463b-95e9-affd4a46d3c4'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:25 user nova-compute[75215]: INFO os_vif [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb')
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:10:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] No VIF found with MAC fa:16:3e:4f:3c:65, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:10:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updated VIF entry in instance network info cache for port e7f3339d-fbff-4a5e-9907-b93df1e452de. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:10:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dcaa98da-47b7-4d1e-adb8-bf05b00142e6 req-9119f55e-7ab4-4df2-a8c7-5455a13b2506 service nova] Releasing lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] No waiting events found dispatching network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:27 user nova-compute[75215]: WARNING nova.compute.manager [req-017989b4-2072-46e7-b211-e94f2e0b90ff req-2d818128-7946-4e51-aae2-4b626a87eb23 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received unexpected event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de for instance with vm_state building and task_state spawning.
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] No waiting events found dispatching network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:29 user nova-compute[75215]: WARNING nova.compute.manager [req-af9456f0-0f6d-4da0-a735-e07ea9ba218b req-c64ec09c-8af9-4e67-a8a5-b4959bb62990 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received unexpected event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de for instance with vm_state building and task_state spawning.
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:10:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Instance spawned successfully.
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:10:29 user nova-compute[75215]: INFO nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 29 15:10:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:10:29 user nova-compute[75215]: INFO nova.compute.manager [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Took 6.21 seconds to build instance.
Nov 29 15:10:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c8bfc20-bdd2-4868-8027-f82673ed2ea2 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.305s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e981fca5-e9c8-4344-bd44-7833cab1356d is timed out.
Nov 29 15:10:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully detached device vdb from instance e981fca5-e9c8-4344-bd44-7833cab1356d from the live domain config.
Nov 29 15:10:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxFveZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:10:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ae843-72cb-445a-9ede-9b4c6814a3a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:10:42 user nova-compute[75215]: No targets found.
Nov 29 15:10:42 user nova-compute[75215]: iSNS:
Nov 29 15:10:42 user nova-compute[75215]: No targets found.
Nov 29 15:10:42 user nova-compute[75215]: STATIC:
Nov 29 15:10:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:10:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7
Nov 29 15:10:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:10:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb
Nov 29 15:10:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:42 user nova-compute[75215]: FIRMWARE:
Nov 29 15:10:42 user nova-compute[75215]: No targets found.
Nov 29 15:10:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:10:42 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:10:42 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9efbd-3d1d-449f-9cd4-b857179b7396]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9676ae3-0a83-4dda-b6e5-96ad9018c5a3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88360160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8830ddfc-0247-4115-bd48-8c2df6c052c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff15f2c9-b72f-409d-bce8-e6cd8b5f4ede]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa8021-4faa-4db3-bef6-e3eee8d363f8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b342d4-b635-4ac6-9f09-531fd0121bb3]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a00c42-1bf7-4254-ba1d-1296675a9146]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c150dd-6071-442f-8d2c-85bd3eb3b10a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260]
Nov 29 15:10:42 user nova-compute[75215]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb, portal: 172.16.0.220,3260] successful.
Nov 29 15:10:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5efc1-0428-4c21-9404-295f58e96a91]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== disconnect_volume: return (331ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:10:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'flavor' on Instance uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93ecc7d0-c150-453b-b633-3630bcb253c3 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.505s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:43 user nova-compute[75215]: INFO nova.compute.manager [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Terminating instance
Nov 29 15:10:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-unplugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] No waiting events found dispatching network-vif-unplugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf88548b-7a04-4c25-8a62-acc85a5f5d4a req-7f2bf4e1-c075-46ee-b592-7a6d629805cd service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-unplugged-9da1e389-5833-4046-8163-08791740ca13 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Instance destroyed successfully.
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lazy-loading 'resources' on Instance uuid e981fca5-e9c8-4344-bd44-7833cab1356d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-673717220',display_name='tempest-VolumesSnapshotTestJSON-instance-673717220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-673717220',id=42,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvl0/t5hkIlvemlQICCZOcuZbWoAFNunxw/ajhE243aZLzDVe77J+8sf4/ZkyKxnvSsdEaTl1YA2owfKSR0tGTP10nTOMo4ekDLyHvaIVXEl79nflZSbGAG4AfauCGPJA==',key_name='tempest-keypair-940075202',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f27c9255ad994fc5b5a61fd9afa8d3e6',ramdisk_id='',reservation_id='r-a04kufqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1046316634',owner_user_name='tempest-VolumesSnapshotTestJSON-1046316634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f590ceb1f6104a838b60c17b79e610c0',uuid=e981fca5-e9c8-4344-bd44-7833cab1356d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converting VIF {"id": "9da1e389-5833-4046-8163-08791740ca13", "address": "fa:16:3e:2e:8f:ed", "network": {"id": "23af52c7-495f-4e4b-bf55-7bd3a057eaf5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776318557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27c9255ad994fc5b5a61fd9afa8d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9da1e389-58", "ovs_interfaceid": "9da1e389-5833-4046-8163-08791740ca13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_vif [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9da1e389-58, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37c9ae7e-5aa9-4eec-91a5-632648ca6a1e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:44 user nova-compute[75215]: INFO os_vif [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8f:ed,bridge_name='br-int',has_traffic_filtering=True,id=9da1e389-5833-4046-8163-08791740ca13,network=Network(23af52c7-495f-4e4b-bf55-7bd3a057eaf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9da1e389-58')
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxFveZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:10:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5dee59-feff-4c43-8129-faa494e1d392]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:10:44 user nova-compute[75215]: No targets found.
Nov 29 15:10:44 user nova-compute[75215]: iSNS:
Nov 29 15:10:44 user nova-compute[75215]: No targets found.
Nov 29 15:10:44 user nova-compute[75215]: STATIC:
Nov 29 15:10:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:10:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7
Nov 29 15:10:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:44 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:10:44 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:10:44 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:10:44 user nova-compute[75215]: FIRMWARE:
Nov 29 15:10:44 user nova-compute[75215]: No targets found.
Nov 29 15:10:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:10:44 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:10:44 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84009450-5665-4136-8c73-3e5b83f4f8bb', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f16ca-89d4-4d4a-894f-59df2d778dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295cf0c-ab60-4a9c-80a9-e07bdc41c69d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:10:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88361bd0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] <== disconnect_volume: return (74ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:10:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Deleting instance files /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d_del
Nov 29 15:10:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Deletion of /opt/stack/data/nova/instances/e981fca5-e9c8-4344-bd44-7833cab1356d_del complete
Nov 29 15:10:44 user nova-compute[75215]: INFO nova.compute.manager [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 15:10:44 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:10:44 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-73765bec-c011-4c01-9f24-f399bc941c15 req-66f072b3-c4ce-4090-a63c-430ad5500a43 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-deleted-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:45 user nova-compute[75215]: INFO nova.compute.manager [req-73765bec-c011-4c01-9f24-f399bc941c15 req-66f072b3-c4ce-4090-a63c-430ad5500a43 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Neutron deleted interface 9da1e389-5833-4046-8163-08791740ca13; detaching it from the instance and deleting it from the info cache
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-73765bec-c011-4c01-9f24-f399bc941c15 req-66f072b3-c4ce-4090-a63c-430ad5500a43 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-73765bec-c011-4c01-9f24-f399bc941c15 req-66f072b3-c4ce-4090-a63c-430ad5500a43 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Detach interface failed, port_id=9da1e389-5833-4046-8163-08791740ca13, reason: Instance e981fca5-e9c8-4344-bd44-7833cab1356d could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:10:45 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Took 0.82 seconds to deallocate network for instance.
Nov 29 15:10:45 user nova-compute[75215]: WARNING nova.volume.cinder [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Attachment 3dc9724b-2c20-4afb-a170-c2e02a47a03c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3dc9724b-2c20-4afb-a170-c2e02a47a03c. (HTTP 404) (Request-ID: req-1856df1e-d576-4612-8e11-c224ba834e9b)
Nov 29 15:10:45 user nova-compute[75215]: INFO nova.compute.manager [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:45 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Deleted allocations for instance e981fca5-e9c8-4344-bd44-7833cab1356d
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1ec3af30-dcb5-4efb-85bd-f5c94f5f1839 tempest-VolumesSnapshotTestJSON-1046316634 tempest-VolumesSnapshotTestJSON-1046316634-project-member] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] Acquiring lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] Lock "e981fca5-e9c8-4344-bd44-7833cab1356d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:10:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] No waiting events found dispatching network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:10:45 user nova-compute[75215]: WARNING nova.compute.manager [req-29b41e75-5f90-4ca6-a56e-19125aacc611 req-119cad5b-2006-4e6f-b5fe-13281c81b936 service nova] [instance: e981fca5-e9c8-4344-bd44-7833cab1356d] Received unexpected event network-vif-plugged-9da1e389-5833-4046-8163-08791740ca13 for instance with vm_state deleted and task_state None.
Nov 29 15:10:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:10:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 1437e255-71df-4865-8863-393f79a57a00] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:11:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating instance_info_cache with network_info: [{"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:11:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-1437e255-71df-4865-8863-393f79a57a00" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:11:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:11:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:11:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=24.90192413330078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1437e255-71df-4865-8863-393f79a57a00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance d78b4793-3fd9-42dc-9c5d-5b93c11c47d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:11:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:11:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing instance network info cache due to event network-changed-febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] Acquiring lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] Acquired lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Refreshing network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:39 user nova-compute[75215]: INFO nova.compute.manager [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Terminating instance
Nov 29 15:11:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Instance destroyed successfully.
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lazy-loading 'resources' on Instance uuid 28e71fbe-9bb3-49b9-81a9-e8682f5d261b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updated VIF entry in instance network info cache for port febbea27-4f3b-41ea-8e47-ab6968d485db. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [{"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T15:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-282916209',display_name='tempest-TestShelveInstance-server-282916209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-282916209',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMve0ct3DVbWEfk7DRrvm9Sx7zXsTlSjR3vlmAe2QMRSuo0hlQSqlS4QIDTJHOyvNEnjHYI7z7rAxD/NUyE5GSHhgwCczXxMDaczIXbri1gxcuCppo1GMcbRgnoLc/YKA==',key_name='tempest-TestShelveInstance-168735512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8de04738dc147e59f8ec5939f29780c',ramdisk_id='',reservation_id='r-hdpemu7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-669488231',owner_user_name='tempest-TestShelveInstance-669488231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:10:05Z,user_data=None,user_id='40d1e71e12bf4a28a73c8ed3ed310a3d',uuid=28e71fbe-9bb3-49b9-81a9-e8682f5d261b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converting VIF {"id": "febbea27-4f3b-41ea-8e47-ab6968d485db", "address": "fa:16:3e:d0:22:b8", "network": {"id": "dd8f28aa-f2af-4774-980d-bbf47e6794cf", "bridge": "br-int", "label": "tempest-TestShelveInstance-443546732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8de04738dc147e59f8ec5939f29780c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebbea27-4f", "ovs_interfaceid": "febbea27-4f3b-41ea-8e47-ab6968d485db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_vif [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebbea27-4f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7b259b7c-adc9-444d-997e-11185db07617 req-cd67022b-ae49-4645-9c6c-3b1a2d578a72 service nova] Releasing lock "refresh_cache-28e71fbe-9bb3-49b9-81a9-e8682f5d261b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7f72edd-309f-4c85-979e-3ac71928832a) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:40 user nova-compute[75215]: INFO os_vif [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:22:b8,bridge_name='br-int',has_traffic_filtering=True,id=febbea27-4f3b-41ea-8e47-ab6968d485db,network=Network(dd8f28aa-f2af-4774-980d-bbf47e6794cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebbea27-4f')
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHRJslmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:11:40 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d550a94d-3b1e-40cd-b70b-4ef1a82168c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:11:40 user nova-compute[75215]: No targets found.
Nov 29 15:11:40 user nova-compute[75215]: iSNS:
Nov 29 15:11:40 user nova-compute[75215]: No targets found.
Nov 29 15:11:40 user nova-compute[75215]: STATIC:
Nov 29 15:11:40 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:11:40 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:11:40 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:11:40 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7
Nov 29 15:11:40 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:11:40 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:11:40 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9
Nov 29 15:11:40 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:11:40 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:11:40 user nova-compute[75215]: FIRMWARE:
Nov 29 15:11:40 user nova-compute[75215]: No targets found.
Nov 29 15:11:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:11:40 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:11:40 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-374228bb-f73e-40ea-86e5-561d13e4c07f req-d69ad93a-9357-441a-bd33-598dda7fe1d6 service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-unplugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf409ba-c274-4e7f-b044-81a8df501055]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84595d1-87d3-44ac-9c00-f63091639432]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:11:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac3e4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c0df14-8165-4e79-82d1-524b0f2b360f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf627f-58d2-4310-9308-c64d2337d7f9]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20dc427-3d69-4c67-b7c9-b14e67f9884a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f078844a-570e-40e1-a2dd-404cfa1bff15]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c881f02-33cb38f8f76edde5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c881f02', '/dev/disk/by-id/scsi-23333636233386638') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:11:40 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO6c881f02-33cb38f8f76edde5
Nov 29 15:11:40 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6c881f02
Nov 29 15:11:40 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23333636233386638
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c84b409-e828-4e7c-bd44-8e23edb524c6]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6a547c-f94a-45a1-85a0-ee0f24ccea95]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8dc17-8552-46a1-88b6-0ca60f1dd275]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260]
Nov 29 15:11:40 user nova-compute[75215]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9, portal: 172.16.0.220,3260] successful.
Nov 29 15:11:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b75bd8-a72a-4f80-bead-b2c01fd67af9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fbfff2-b5f4-43dc-bec6-437dd97c5ebf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] <== disconnect_volume: return (330ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:11:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:11:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deleting instance files /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b_del
Nov 29 15:11:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deletion of /opt/stack/data/nova/instances/28e71fbe-9bb3-49b9-81a9-e8682f5d261b_del complete
Nov 29 15:11:41 user nova-compute[75215]: INFO nova.compute.manager [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 29 15:11:41 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:11:41 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:11:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:11:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:11:41 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Took 0.40 seconds to deallocate network for instance.
Nov 29 15:11:42 user nova-compute[75215]: INFO nova.compute.manager [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Deleting volume: f2b75bd8-a72a-4f80-bead-b2c01fd67af9 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:42 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Deleted allocations for instance 28e71fbe-9bb3-49b9-81a9-e8682f5d261b
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84b8e352-9beb-4779-a497-24dff297d095 tempest-TestShelveInstance-669488231 tempest-TestShelveInstance-669488231-project-member] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] Acquiring lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] Lock "28e71fbe-9bb3-49b9-81a9-e8682f5d261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] No waiting events found dispatching network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:11:42 user nova-compute[75215]: WARNING nova.compute.manager [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received unexpected event network-vif-plugged-febbea27-4f3b-41ea-8e47-ab6968d485db for instance with vm_state deleted and task_state None.
Nov 29 15:11:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-bcc273c9-a9d8-460b-b203-967777ed1aab req-939b807a-d4d0-4722-a150-072c360ae4bb service nova] [instance: 28e71fbe-9bb3-49b9-81a9-e8682f5d261b] Received event network-vif-deleted-febbea27-4f3b-41ea-8e47-ab6968d485db {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-changed-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Refreshing instance network info cache due to event network-changed-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] Acquiring lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] Acquired lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Refreshing network info cache for port bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updated VIF entry in instance network info cache for port bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updating instance_info_cache with network_info: [{"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d7087f0e-58ac-403b-b660-dff6caf930a9 req-13cb6eea-ab1c-4743-a869-19a5dfa0a99f service nova] Releasing lock "refresh_cache-d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:44 user nova-compute[75215]: INFO nova.compute.manager [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Terminating instance
Nov 29 15:11:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-unplugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] No waiting events found dispatching network-vif-unplugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-f33e5a32-34ca-4356-aa51-0a60e8bcce03 req-ab0d4a6e-ceb1-470b-95b7-6ed2eb8e9521 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-unplugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Instance destroyed successfully.
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid d78b4793-3fd9-42dc-9c5d-5b93c11c47d9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-72905601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-72905601',id=43,image_ref='e2dad8b3-3210-4f1f-b136-fa38868e031d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHFgG8vyiwcJRXeqps293kfgjqmyQjmMVUyjSz8bcALTKLDJ7c7TKR2GBKJ8CbI6XFWdEUue0e/ESgULYUefnS+b9s5aVeJMXNmd0xEvpevufJ7s9q9KZiZCVxP94aIkA==',key_name='tempest-keypair-755574447',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:10:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-dywrukn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-288309841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=d78b4793-3fd9-42dc-9c5d-5b93c11c47d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "address": "fa:16:3e:dc:bb:ef", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf6f7f9-49", "ovs_interfaceid": "bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_vif [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcf6f7f9-49, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=894b1470-3add-44d0-86b4-b71086a20478) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:45 user nova-compute[75215]: INFO os_vif [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:bb:ef,bridge_name='br-int',has_traffic_filtering=True,id=bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf6f7f9-49')
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmAVDxOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:11:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d104bb51-0d21-492e-bcba-b81306811c02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:11:45 user nova-compute[75215]: No targets found.
Nov 29 15:11:45 user nova-compute[75215]: iSNS:
Nov 29 15:11:45 user nova-compute[75215]: No targets found.
Nov 29 15:11:45 user nova-compute[75215]: STATIC:
Nov 29 15:11:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:11:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:11:45 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:11:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7
Nov 29 15:11:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:11:45 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:11:45 user nova-compute[75215]: FIRMWARE:
Nov 29 15:11:45 user nova-compute[75215]: No targets found.
Nov 29 15:11:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:11:45 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:11:45 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82ccc0-c067-49b5-b8e9-165eabdc8bf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c1d06-4034-4bf2-ba03-f619ab4bc52f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:11:45 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:11:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:11:45 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 (non-flash)
Nov 29 15:11:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac65ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b997ea-06c0-49a7-afd2-374afe35f25b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f626f0d9-ab06-4037-a547-97eb7310fac9]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc3c91-4ed4-4274-ac20-b7c6a17b0989]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c18616-7e62-44cc-bd33-a9daee996440]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a246b14-6c43-40ff-80d6-0d98346ddb7b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279ceb2-abfa-4eb7-8276-41039e8c8393]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260]
Nov 29 15:11:45 user nova-compute[75215]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7, portal: 172.16.0.220,3260] successful.
Nov 29 15:11:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a802bd0-4129-466f-9657-fbcf9ebc47d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98921562-9f4f-4975-bdf2-59c20a400e02]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (298ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:11:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Deleting instance files /opt/stack/data/nova/instances/d78b4793-3fd9-42dc-9c5d-5b93c11c47d9_del
Nov 29 15:11:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Deletion of /opt/stack/data/nova/instances/d78b4793-3fd9-42dc-9c5d-5b93c11c47d9_del complete
Nov 29 15:11:45 user nova-compute[75215]: INFO nova.compute.manager [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 15:11:45 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:11:45 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:11:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] Acquiring lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] No waiting events found dispatching network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:11:47 user nova-compute[75215]: WARNING nova.compute.manager [req-5a7ebc42-5f7f-41eb-88ce-5adb0de86bba req-829f22a1-8b8f-4af3-aa47-38e195991187 service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received unexpected event network-vif-plugged-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac for instance with vm_state active and task_state deleting.
Nov 29 15:11:47 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:11:47 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Took 1.36 seconds to deallocate network for instance.
Nov 29 15:11:47 user nova-compute[75215]: INFO nova.compute.manager [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 15:11:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Deleting volume: 3a802bd0-4129-466f-9657-fbcf9ebc47d7 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 15:11:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:11:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:11:48 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:11:48 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:11:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:48 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance d78b4793-3fd9-42dc-9c5d-5b93c11c47d9
Nov 29 15:11:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d79c0f42-edfa-4a18-90af-f9acf86dd8bb tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "d78b4793-3fd9-42dc-9c5d-5b93c11c47d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.729s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:11:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-56473e6e-84c3-4deb-8c09-c97bcaadc66d req-6bbc1e4a-b1fb-4765-aff5-68013b77d11d service nova] [instance: d78b4793-3fd9-42dc-9c5d-5b93c11c47d9] Received event network-vif-deleted-bcf6f7f9-49d3-4c6a-90d9-11d3b7e35bac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:11:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:11:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:12:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:12:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:12:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:14 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:12:14 user nova-compute[75215]: INFO nova.compute.claims [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Claim successful on node user
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:12:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.policy [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3b87f40b5f943debc89110626be29e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd655981e000d4997aa5db8bc1d79dc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:12:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Creating image(s)
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "/opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "/opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "/opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Successfully created port: 95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Cannot resize image /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Ensure instance console log exists: /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Successfully updated port: 95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquired lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-changed-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Refreshing instance network info cache due to event network-changed-95d3f3c6-e91b-435a-8141-cd7162d78ad9. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] Acquiring lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:12:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Updating instance_info_cache with network_info: [{"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Releasing lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Instance network_info: |[{"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] Acquired lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Refreshing network info cache for port 95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Start _get_guest_xml network_info=[{"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:12:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:12:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-313778839',display_name='tempest-ServersNegativeTestJSON-server-313778839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-313778839',id=45,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-hb0mnwp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:12:15Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=192c3cd3-c610-4628-84df-0acd066b8970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lazy-loading 'pci_devices' on Instance uuid 192c3cd3-c610-4628-84df-0acd066b8970 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:12:17 user nova-compute[75215]:   <uuid>192c3cd3-c610-4628-84df-0acd066b8970</uuid>
Nov 29 15:12:17 user nova-compute[75215]:   <name>instance-0000002d</name>
Nov 29 15:12:17 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:12:17 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:12:17 user nova-compute[75215]:   <metadata>
Nov 29 15:12:17 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:12:17 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:name>tempest-ServersNegativeTestJSON-server-313778839</nova:name>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:12:17</nova:creationTime>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:12:17 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:12:17 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:owner>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:user uuid="e3b87f40b5f943debc89110626be29e3">tempest-ServersNegativeTestJSON-1652934373-project-member</nova:user>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:project uuid="d655981e000d4997aa5db8bc1d79dc5d">tempest-ServersNegativeTestJSON-1652934373</nova:project>
Nov 29 15:12:17 user nova-compute[75215]:       </nova:owner>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:12:17 user nova-compute[75215]:       <nova:ports>
Nov 29 15:12:17 user nova-compute[75215]:         <nova:port uuid="95d3f3c6-e91b-435a-8141-cd7162d78ad9">
Nov 29 15:12:17 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 15:12:17 user nova-compute[75215]:         </nova:port>
Nov 29 15:12:17 user nova-compute[75215]:       </nova:ports>
Nov 29 15:12:17 user nova-compute[75215]:     </nova:instance>
Nov 29 15:12:17 user nova-compute[75215]:   </metadata>
Nov 29 15:12:17 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:12:17 user nova-compute[75215]:     <system>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="serial">192c3cd3-c610-4628-84df-0acd066b8970</entry>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="uuid">192c3cd3-c610-4628-84df-0acd066b8970</entry>
Nov 29 15:12:17 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:12:17 user nova-compute[75215]:     </system>
Nov 29 15:12:17 user nova-compute[75215]:   </sysinfo>
Nov 29 15:12:17 user nova-compute[75215]:   <os>
Nov 29 15:12:17 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:12:17 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:12:17 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:12:17 user nova-compute[75215]:   </os>
Nov 29 15:12:17 user nova-compute[75215]:   <features>
Nov 29 15:12:17 user nova-compute[75215]:     <acpi/>
Nov 29 15:12:17 user nova-compute[75215]:     <apic/>
Nov 29 15:12:17 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:12:17 user nova-compute[75215]:   </features>
Nov 29 15:12:17 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:12:17 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:12:17 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:12:17 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:12:17 user nova-compute[75215]:   </clock>
Nov 29 15:12:17 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:12:17 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:12:17 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:12:17 user nova-compute[75215]:   </cpu>
Nov 29 15:12:17 user nova-compute[75215]:   <devices>
Nov 29 15:12:17 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:12:17 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:12:17 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk"/>
Nov 29 15:12:17 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:12:17 user nova-compute[75215]:     </disk>
Nov 29 15:12:17 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:12:17 user nova-compute[75215]:       <mac address="fa:16:3e:13:a6:4d"/>
Nov 29 15:12:17 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:12:17 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:12:17 user nova-compute[75215]:       <target dev="tap95d3f3c6-e9"/>
Nov 29 15:12:17 user nova-compute[75215]:     </interface>
Nov 29 15:12:17 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:12:17 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/console.log" append="off"/>
Nov 29 15:12:17 user nova-compute[75215]:     </serial>
Nov 29 15:12:17 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:12:17 user nova-compute[75215]:     <video>
Nov 29 15:12:17 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:12:17 user nova-compute[75215]:     </video>
Nov 29 15:12:17 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:12:17 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:12:17 user nova-compute[75215]:     </rng>
Nov 29 15:12:17 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:12:17 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:12:17 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:12:17 user nova-compute[75215]:     </memballoon>
Nov 29 15:12:17 user nova-compute[75215]:   </devices>
Nov 29 15:12:17 user nova-compute[75215]: </domain>
Nov 29 15:12:17 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-313778839',display_name='tempest-ServersNegativeTestJSON-server-313778839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-313778839',id=45,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-hb0mnwp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:12:15Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=192c3cd3-c610-4628-84df-0acd066b8970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG os_vif [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3797fe6e-b30b-58fa-b04f-eba1549b0b7f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95d3f3c6-e9, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95d3f3c6-e9, col_values=(('qos', UUID('8fbef914-5058-4ad7-86f6-9848592f39e7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95d3f3c6-e9, col_values=(('external_ids', {'iface-id': '95d3f3c6-e91b-435a-8141-cd7162d78ad9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a6:4d', 'vm-uuid': '192c3cd3-c610-4628-84df-0acd066b8970'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:17 user nova-compute[75215]: INFO os_vif [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9')
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] No VIF found with MAC fa:16:3e:13:a6:4d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Updated VIF entry in instance network info cache for port 95d3f3c6-e91b-435a-8141-cd7162d78ad9. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Updating instance_info_cache with network_info: [{"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:12:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b809523a-02bd-4d0e-94ca-d5cb07ccdb56 req-1ea04bc8-4313-465b-ab45-c87794e40cce service nova] Releasing lock "refresh_cache-192c3cd3-c610-4628-84df-0acd066b8970" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:12:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] No waiting events found dispatching network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:12:19 user nova-compute[75215]: WARNING nova.compute.manager [req-f998361c-dd8d-46fc-8fc8-34ea7bd01dd9 req-53184fe7-a5fc-42a4-8140-1fa661018049 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received unexpected event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 for instance with vm_state building and task_state spawning.
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:12:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:12:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:12:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=24.898815155029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Instance spawned successfully.
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] No waiting events found dispatching network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:12:21 user nova-compute[75215]: WARNING nova.compute.manager [req-7d65ed85-efbe-479d-9aa0-fd503362a113 req-7eb6b715-a125-4279-860b-ac873f2bf9f0 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received unexpected event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 for instance with vm_state building and task_state spawning.
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 1437e255-71df-4865-8863-393f79a57a00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 192c3cd3-c610-4628-84df-0acd066b8970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:12:21 user nova-compute[75215]: INFO nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:12:21 user nova-compute[75215]: INFO nova.compute.manager [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Took 6.51 seconds to build instance.
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1a5f1996-e60b-47d9-bb1d-1e96dc6fb83f tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:12:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:12:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:39 user nova-compute[75215]: INFO nova.compute.manager [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Terminating instance
Nov 29 15:12:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-unplugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] No waiting events found dispatching network-vif-unplugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-3af2e66d-6931-4568-85b1-0e9949fd334f req-a6331b1f-c704-4498-8b36-f5c3766cc4f4 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-unplugged-35e5677b-3d55-4f05-9f58-b1463b58a399 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:12:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] Instance destroyed successfully.
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid 1437e255-71df-4865-8863-393f79a57a00 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1918833537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1918833537',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF0l4Gg/ZkYYLx++RDsLyMyYxa61kwnKnOeOvaIvX1jZFQvA9x4UaYJbeGULSrjUeK1Zo7eUPh5KBLA3IlF2QBYUZ03RRZuViupdIqGmg81xSQKok8WwXomSgFfLWmR8A==',key_name='tempest-keypair-470139118',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-df9fy595',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=1437e255-71df-4865-8863-393f79a57a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "35e5677b-3d55-4f05-9f58-b1463b58a399", "address": "fa:16:3e:f2:59:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35e5677b-3d", "ovs_interfaceid": "35e5677b-3d55-4f05-9f58-b1463b58a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_vif [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35e5677b-3d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66317d77-cf4f-4b93-876f-488f8a8a91ab) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:12:40 user nova-compute[75215]: INFO os_vif [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:59:f5,bridge_name='br-int',has_traffic_filtering=True,id=35e5677b-3d55-4f05-9f58-b1463b58a399,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35e5677b-3d')
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbTqejJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:12:40 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[078f653c-4354-4e0f-8b86-878df85cd6da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:12:40 user nova-compute[75215]: No targets found.
Nov 29 15:12:40 user nova-compute[75215]: iSNS:
Nov 29 15:12:40 user nova-compute[75215]: No targets found.
Nov 29 15:12:40 user nova-compute[75215]: STATIC:
Nov 29 15:12:40 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478
Nov 29 15:12:40 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:12:40 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:12:40 user nova-compute[75215]: FIRMWARE:
Nov 29 15:12:40 user nova-compute[75215]: No targets found.
Nov 29 15:12:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:12:40 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:12:40 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffbddfc-48b1-4d81-8012-e8df799de6fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba233ca2-8419-4656-81d2-d83065390b8a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:12:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 (non-flash)
Nov 29 15:12:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac3ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5526a2b-7446-46b6-9f3d-00a8374c669e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6f9f71-d615-4db7-907b-7e3c634f5db7]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa74aa-7a65-49ff-b716-928daf768018]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c18659-eda8-48e2-acaa-03eb3066725a]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26166653437386136', '/dev/disk/by-id/scsi-1SCST_BIO597fa7d2-afe478a68d1bafe0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_597fa7d2') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[093e7349-9c12-4e30-8bdf-06e9e3417caa]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a796b-7014-4135-ade3-d193c0127d08]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc5443-ede2-4fb8-bc23-7f6157710fb0]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260]
Nov 29 15:12:40 user nova-compute[75215]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478, portal: 172.16.0.220,3260] successful.
Nov 29 15:12:40 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c4ac46-78d0-4c81-9333-679a158c9478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b9c701-2e61-4b02-b1a0-fb402bc29ee4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (326ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:12:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Deleting instance files /opt/stack/data/nova/instances/1437e255-71df-4865-8863-393f79a57a00_del
Nov 29 15:12:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Deletion of /opt/stack/data/nova/instances/1437e255-71df-4865-8863-393f79a57a00_del complete
Nov 29 15:12:40 user nova-compute[75215]: INFO nova.compute.manager [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 15:12:40 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:12:40 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:12:41 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 1437e255-71df-4865-8863-393f79a57a00] Took 0.70 seconds to deallocate network for instance.
Nov 29 15:12:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-6984f195-33ed-4401-bfe8-8c4d0631ae40 req-5bb14b80-5248-48a9-839c-95bd53479943 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-deleted-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] Acquiring lock "1437e255-71df-4865-8863-393f79a57a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] Lock "1437e255-71df-4865-8863-393f79a57a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] No waiting events found dispatching network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:12:42 user nova-compute[75215]: WARNING nova.compute.manager [req-56d374dc-dbfc-4bb1-9238-afdfe0052336 req-26a457a8-2bf0-48aa-bf94-82c4425cd801 service nova] [instance: 1437e255-71df-4865-8863-393f79a57a00] Received unexpected event network-vif-plugged-35e5677b-3d55-4f05-9f58-b1463b58a399 for instance with vm_state active and task_state deleting.
Nov 29 15:12:42 user nova-compute[75215]: INFO nova.compute.manager [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Took 0.85 seconds to detach 1 volumes for instance.
Nov 29 15:12:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 1437e255-71df-4865-8863-393f79a57a00] Deleting volume: b6c4ac46-78d0-4c81-9333-679a158c9478 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:42 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance 1437e255-71df-4865-8863-393f79a57a00
Nov 29 15:12:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9758f2d8-3695-4d4a-aafd-3e47cf51d20a tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "1437e255-71df-4865-8863-393f79a57a00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:12:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:12:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:13:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 36917fd7-1fb8-463b-95e9-affd4a46d3c4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:13:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:13:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:13:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.860408782958984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 192c3cd3-c610-4628-84df-0acd066b8970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:13:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:13:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:13:41 user nova-compute[75215]: INFO nova.compute.claims [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Claim successful on node user
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:13:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.policy [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:13:41 user nova-compute[75215]: INFO nova.virt.block_device [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Booting with volume 75240efe-3e1e-488b-800e-ce739c553a8f at /dev/vda
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.utils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e86b85-09b1-4165-9659-340a92975c66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e434d9-9630-46d1-b309-6b27c22bcaad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b846d30c-0212-4e10-bf3b-905921582d0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[54619fb8-a575-4f01-be65-7dc8ce81aaed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:13:41 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:13:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77bb01-0bc0-452f-bacd-fed9028dd144]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG os_brick.utils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:13:41 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updating existing volume attachment record: 1a81566e-aa38-4a3b-9448-afeb0ec69469 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Successfully created port: 41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Successfully updated port: 41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-changed-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Refreshing instance network info cache due to event network-changed-41fd8340-a195-464f-9f9a-c4eb8d6d6c89. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] Acquiring lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:13:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updating instance_info_cache with network_info: [{"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Instance network_info: |[{"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] Acquired lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Refreshing network info cache for port 41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updated VIF entry in instance network info cache for port 41fd8340-a195-464f-9f9a-c4eb8d6d6c89. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updating instance_info_cache with network_info: [{"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4dc0d225-97bf-4870-97c6-6ad7b0b64249 req-9a574ee6-94d0-4e74-9954-acf5c1fee0eb service nova] Releasing lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:13:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:13:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Creating image(s)
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Ensure instance console log exists: /opt/stack/data/nova/instances/43d93365-7e5f-49c2-aa53-73fbc002c3c2/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Start _get_guest_xml network_info=[{"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1a81566e-aa38-4a3b-9448-afeb0ec69469', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43d93365-7e5f-49c2-aa53-73fbc002c3c2', 'attached_at': '', 'detached_at': '', 'volume_id': '75240efe-3e1e-488b-800e-ce739c553a8f', 'serial': '75240efe-3e1e-488b-800e-ce739c553a8f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:13:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:13:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:13:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:13:49 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85479d1-ea02-440e-a7c8-02368a4ee3b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:13:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4efd843-c517-4ba1-b099-5dac32deb980]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f] added
Nov 29 15:13:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b36004-1af7-496d-9f46-b35ad488bafc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba69e6-c127-4bfc-9ced-5d9b4aaa7fc9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBLotYQf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBLotYQf" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e104f-9da4-49fa-90ea-5d901f3ba477]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBLotYQf'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae4261d-6a8c-4c50-8433-71705edd8c6f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[839d722e-3667-480d-85a8-0e11fca32dcc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:13:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:13:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:13:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:13:49 user nova-compute[75215]: 
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b41d3b0-5d5a-4de6-b8fe-4fd0c2f0e4f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]
Nov 29 15:13:49 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.
Nov 29 15:13:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1fd89-3bb1-4d03-89a4-fc6ac05e6367]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01682bd6-4cb0-400b-88bf-02cd1121a2e5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:13:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:13:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6604128-42e9-458c-ad72-0ebdae0c2af9]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:13:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:13:50 user nova-compute[75215]: INFO nova.compute.claims [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Claim successful on node user
Nov 29 15:13:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26139323463343837', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139323463343837', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2121049814',display_name='tempest-TestVolumeBootPattern-server-2121049814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2121049814',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-rcjzsbk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:13:41Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=43d93365-7e5f-49c2-aa53-73fbc002c3c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid 43d93365-7e5f-49c2-aa53-73fbc002c3c2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:13:50 user nova-compute[75215]:   <uuid>43d93365-7e5f-49c2-aa53-73fbc002c3c2</uuid>
Nov 29 15:13:50 user nova-compute[75215]:   <name>instance-0000002e</name>
Nov 29 15:13:50 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:13:50 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:13:50 user nova-compute[75215]:   <metadata>
Nov 29 15:13:50 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:13:50 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:13:50 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-2121049814</nova:name>
Nov 29 15:13:50 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:13:49</nova:creationTime>
Nov 29 15:13:50 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:13:50 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:13:50 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:13:50 user nova-compute[75215]:       <nova:owner>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:13:50 user nova-compute[75215]:       </nova:owner>
Nov 29 15:13:50 user nova-compute[75215]:       <nova:ports>
Nov 29 15:13:50 user nova-compute[75215]:         <nova:port uuid="41fd8340-a195-464f-9f9a-c4eb8d6d6c89">
Nov 29 15:13:50 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 15:13:50 user nova-compute[75215]:         </nova:port>
Nov 29 15:13:50 user nova-compute[75215]:       </nova:ports>
Nov 29 15:13:50 user nova-compute[75215]:     </nova:instance>
Nov 29 15:13:50 user nova-compute[75215]:   </metadata>
Nov 29 15:13:50 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:13:50 user nova-compute[75215]:     <system>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="serial">43d93365-7e5f-49c2-aa53-73fbc002c3c2</entry>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="uuid">43d93365-7e5f-49c2-aa53-73fbc002c3c2</entry>
Nov 29 15:13:50 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:13:50 user nova-compute[75215]:     </system>
Nov 29 15:13:50 user nova-compute[75215]:   </sysinfo>
Nov 29 15:13:50 user nova-compute[75215]:   <os>
Nov 29 15:13:50 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:13:50 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:13:50 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:13:50 user nova-compute[75215]:   </os>
Nov 29 15:13:50 user nova-compute[75215]:   <features>
Nov 29 15:13:50 user nova-compute[75215]:     <acpi/>
Nov 29 15:13:50 user nova-compute[75215]:     <apic/>
Nov 29 15:13:50 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:13:50 user nova-compute[75215]:   </features>
Nov 29 15:13:50 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:13:50 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:13:50 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:13:50 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:13:50 user nova-compute[75215]:   </clock>
Nov 29 15:13:50 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:13:50 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:13:50 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:13:50 user nova-compute[75215]:   </cpu>
Nov 29 15:13:50 user nova-compute[75215]:   <devices>
Nov 29 15:13:50 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:13:50 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:13:50 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:13:50 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:13:50 user nova-compute[75215]:       <serial>75240efe-3e1e-488b-800e-ce739c553a8f</serial>
Nov 29 15:13:50 user nova-compute[75215]:     </disk>
Nov 29 15:13:50 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:13:50 user nova-compute[75215]:       <mac address="fa:16:3e:56:1c:56"/>
Nov 29 15:13:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:13:50 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:13:50 user nova-compute[75215]:       <target dev="tap41fd8340-a1"/>
Nov 29 15:13:50 user nova-compute[75215]:     </interface>
Nov 29 15:13:50 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:13:50 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/43d93365-7e5f-49c2-aa53-73fbc002c3c2/console.log" append="off"/>
Nov 29 15:13:50 user nova-compute[75215]:     </serial>
Nov 29 15:13:50 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:13:50 user nova-compute[75215]:     <video>
Nov 29 15:13:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:13:50 user nova-compute[75215]:     </video>
Nov 29 15:13:50 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:13:50 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:13:50 user nova-compute[75215]:     </rng>
Nov 29 15:13:50 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:13:50 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:13:50 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:13:50 user nova-compute[75215]:     </memballoon>
Nov 29 15:13:50 user nova-compute[75215]:   </devices>
Nov 29 15:13:50 user nova-compute[75215]: </domain>
Nov 29 15:13:50 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2121049814',display_name='tempest-TestVolumeBootPattern-server-2121049814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2121049814',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-rcjzsbk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:13:41Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=43d93365-7e5f-49c2-aa53-73fbc002c3c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG os_vif [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f7feaf9-b871-5b57-80be-c6add16dff3c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41fd8340-a1, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41fd8340-a1, col_values=(('qos', UUID('b313afb0-a78c-41ad-8c9f-0d9a16f00cc6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41fd8340-a1, col_values=(('external_ids', {'iface-id': '41fd8340-a195-464f-9f9a-c4eb8d6d6c89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1c:56', 'vm-uuid': '43d93365-7e5f-49c2-aa53-73fbc002c3c2'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:50 user nova-compute[75215]: INFO os_vif [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1')
Nov 29 15:13:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:56:1c:56, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:13:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.policy [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f9b399eea834505860648a3a3537ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41dba2522afe4249bc29b8a0983b6b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:13:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Creating image(s)
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "/opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "/opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "/opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Successfully created port: 820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:13:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Cannot resize image /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Ensure instance console log exists: /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] No waiting events found dispatching network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:13:52 user nova-compute[75215]: WARNING nova.compute.manager [req-60d0fe4c-180f-44c1-a4dc-8ce43cc92f28 req-f64ebcef-1fb1-4aa6-9d1b-62317ffe4139 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received unexpected event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 for instance with vm_state building and task_state spawning.
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Successfully updated port: 820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-changed-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Refreshing instance network info cache due to event network-changed-820f549a-8f0a-47c2-84c4-f6358b023754. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Instance network_info: |[{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Refreshing network info cache for port 820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Start _get_guest_xml network_info=[{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:13:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-709367052',display_name='tempest-SnapshotDataIntegrityTests-server-709367052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-709367052',id=47,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0FrXD50XnX5UvlkCbFgg59GY+WMEwbEAr5Vn/00ateOlR2g4gvawwBcCzLNSWqH77WjdDzFRDLS7Sr+VnCyGyV1Q8ejhy5P3L4Lb+/Sha5lg97npAhhI+umduvx343A==',key_name='tempest-keypair-582796785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41dba2522afe4249bc29b8a0983b6b2e',ramdisk_id='',reservation_id='r-f1dplm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2097192493',owner_user_name='tempest-SnapshotDataIntegrityTests-2097192493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f9b399eea834505860648a3a3537ffd',uuid=14321ff4-a1f0-4c37-8288-caeec1849948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converting VIF {"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'pci_devices' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:13:53 user nova-compute[75215]:   <uuid>14321ff4-a1f0-4c37-8288-caeec1849948</uuid>
Nov 29 15:13:53 user nova-compute[75215]:   <name>instance-0000002f</name>
Nov 29 15:13:53 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:13:53 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:13:53 user nova-compute[75215]:   <metadata>
Nov 29 15:13:53 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:13:53 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-709367052</nova:name>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:13:53</nova:creationTime>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:13:53 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:13:53 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:owner>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:user uuid="7f9b399eea834505860648a3a3537ffd">tempest-SnapshotDataIntegrityTests-2097192493-project-member</nova:user>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:project uuid="41dba2522afe4249bc29b8a0983b6b2e">tempest-SnapshotDataIntegrityTests-2097192493</nova:project>
Nov 29 15:13:53 user nova-compute[75215]:       </nova:owner>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:13:53 user nova-compute[75215]:       <nova:ports>
Nov 29 15:13:53 user nova-compute[75215]:         <nova:port uuid="820f549a-8f0a-47c2-84c4-f6358b023754">
Nov 29 15:13:53 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 15:13:53 user nova-compute[75215]:         </nova:port>
Nov 29 15:13:53 user nova-compute[75215]:       </nova:ports>
Nov 29 15:13:53 user nova-compute[75215]:     </nova:instance>
Nov 29 15:13:53 user nova-compute[75215]:   </metadata>
Nov 29 15:13:53 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:13:53 user nova-compute[75215]:     <system>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="serial">14321ff4-a1f0-4c37-8288-caeec1849948</entry>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="uuid">14321ff4-a1f0-4c37-8288-caeec1849948</entry>
Nov 29 15:13:53 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:13:53 user nova-compute[75215]:     </system>
Nov 29 15:13:53 user nova-compute[75215]:   </sysinfo>
Nov 29 15:13:53 user nova-compute[75215]:   <os>
Nov 29 15:13:53 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:13:53 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:13:53 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:13:53 user nova-compute[75215]:   </os>
Nov 29 15:13:53 user nova-compute[75215]:   <features>
Nov 29 15:13:53 user nova-compute[75215]:     <acpi/>
Nov 29 15:13:53 user nova-compute[75215]:     <apic/>
Nov 29 15:13:53 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:13:53 user nova-compute[75215]:   </features>
Nov 29 15:13:53 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:13:53 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:13:53 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:13:53 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:13:53 user nova-compute[75215]:   </clock>
Nov 29 15:13:53 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:13:53 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:13:53 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:13:53 user nova-compute[75215]:   </cpu>
Nov 29 15:13:53 user nova-compute[75215]:   <devices>
Nov 29 15:13:53 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:13:53 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:13:53 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk"/>
Nov 29 15:13:53 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:13:53 user nova-compute[75215]:     </disk>
Nov 29 15:13:53 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:13:53 user nova-compute[75215]:       <mac address="fa:16:3e:a5:89:9e"/>
Nov 29 15:13:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:13:53 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:13:53 user nova-compute[75215]:       <target dev="tap820f549a-8f"/>
Nov 29 15:13:53 user nova-compute[75215]:     </interface>
Nov 29 15:13:53 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:13:53 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/console.log" append="off"/>
Nov 29 15:13:53 user nova-compute[75215]:     </serial>
Nov 29 15:13:53 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:13:53 user nova-compute[75215]:     <video>
Nov 29 15:13:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:13:53 user nova-compute[75215]:     </video>
Nov 29 15:13:53 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:13:53 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:13:53 user nova-compute[75215]:     </rng>
Nov 29 15:13:53 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:13:53 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:13:53 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:13:53 user nova-compute[75215]:     </memballoon>
Nov 29 15:13:53 user nova-compute[75215]:   </devices>
Nov 29 15:13:53 user nova-compute[75215]: </domain>
Nov 29 15:13:53 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-709367052',display_name='tempest-SnapshotDataIntegrityTests-server-709367052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-709367052',id=47,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0FrXD50XnX5UvlkCbFgg59GY+WMEwbEAr5Vn/00ateOlR2g4gvawwBcCzLNSWqH77WjdDzFRDLS7Sr+VnCyGyV1Q8ejhy5P3L4Lb+/Sha5lg97npAhhI+umduvx343A==',key_name='tempest-keypair-582796785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41dba2522afe4249bc29b8a0983b6b2e',ramdisk_id='',reservation_id='r-f1dplm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2097192493',owner_user_name='tempest-SnapshotDataIntegrityTests-2097192493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f9b399eea834505860648a3a3537ffd',uuid=14321ff4-a1f0-4c37-8288-caeec1849948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converting VIF {"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG os_vif [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '433e8f11-17a9-556e-85a8-09b93e1986a0', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap820f549a-8f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap820f549a-8f, col_values=(('qos', UUID('60dc31a8-731d-4335-a726-f43e7f6dfe70')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap820f549a-8f, col_values=(('external_ids', {'iface-id': '820f549a-8f0a-47c2-84c4-f6358b023754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:89:9e', 'vm-uuid': '14321ff4-a1f0-4c37-8288-caeec1849948'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:53 user nova-compute[75215]: INFO os_vif [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f')
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No VIF found with MAC fa:16:3e:a5:89:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updated VIF entry in instance network info cache for port 820f549a-8f0a-47c2-84c4-f6358b023754. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:13:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e9cc1a7-8950-4063-83cb-44d136dd360d req-9896e5eb-7428-4dea-98d7-12331b1e0963 service nova] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:13:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Instance spawned successfully.
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] No waiting events found dispatching network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:13:54 user nova-compute[75215]: WARNING nova.compute.manager [req-541ee22f-8776-4008-866c-66cb01b62598 req-4c207b0d-038f-4259-9591-24f1d187fc86 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received unexpected event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 for instance with vm_state building and task_state spawning.
Nov 29 15:13:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:54 user nova-compute[75215]: INFO nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 29 15:13:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:54 user nova-compute[75215]: INFO nova.compute.manager [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Took 13.74 seconds to build instance.
Nov 29 15:13:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d7645f2c-80c6-4d81-b5b9-d80924bb9b2d tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.898s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] No waiting events found dispatching network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:13:56 user nova-compute[75215]: WARNING nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received unexpected event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 for instance with vm_state building and task_state spawning.
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] No waiting events found dispatching network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:13:56 user nova-compute[75215]: WARNING nova.compute.manager [req-2c31fa7b-7b04-45b8-b7af-38061b51146a req-bceb7bb8-b4c4-40b9-9d62-6ce616fbe223 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received unexpected event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 for instance with vm_state building and task_state spawning.
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:13:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Instance spawned successfully.
Nov 29 15:13:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:13:57 user nova-compute[75215]: INFO nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 29 15:13:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:13:57 user nova-compute[75215]: INFO nova.compute.manager [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Took 6.71 seconds to build instance.
Nov 29 15:13:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e96e49e6-3cb6-4595-b9f0-86042af7863c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:13:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:13:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:05 user nova-compute[75215]: INFO nova.compute.manager [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Terminating instance
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-unplugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] No waiting events found dispatching network-vif-unplugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-869a697b-9d03-4410-9f59-1ccbfebdaa31 req-31a27b82-5597-4570-bbd9-9a32ec30cc74 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-unplugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Instance destroyed successfully.
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lazy-loading 'resources' on Instance uuid 192c3cd3-c610-4628-84df-0acd066b8970 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-313778839',display_name='tempest-ServersNegativeTestJSON-server-313778839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-313778839',id=45,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-hb0mnwp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:12:21Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=192c3cd3-c610-4628-84df-0acd066b8970,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "address": "fa:16:3e:13:a6:4d", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d3f3c6-e9", "ovs_interfaceid": "95d3f3c6-e91b-435a-8141-cd7162d78ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG os_vif [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95d3f3c6-e9, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fbef914-5058-4ad7-86f6-9848592f39e7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:14:05 user nova-compute[75215]: INFO os_vif [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:4d,bridge_name='br-int',has_traffic_filtering=True,id=95d3f3c6-e91b-435a-8141-cd7162d78ad9,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d3f3c6-e9')
Nov 29 15:14:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Deleting instance files /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970_del
Nov 29 15:14:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Deletion of /opt/stack/data/nova/instances/192c3cd3-c610-4628-84df-0acd066b8970_del complete
Nov 29 15:14:05 user nova-compute[75215]: INFO nova.compute.manager [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 15:14:05 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:14:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:14:06 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Took 0.57 seconds to deallocate network for instance.
Nov 29 15:14:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-f25bafaa-71a2-4d97-86c6-aaa32a3feaa3 req-64ca2518-d5aa-467e-bd39-213b2ac7cd88 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-deleted-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:06 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Deleted allocations for instance 192c3cd3-c610-4628-84df-0acd066b8970
Nov 29 15:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9dabc0f0-62e5-4603-9fe0-54fe7bc4601c tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "192c3cd3-c610-4628-84df-0acd066b8970" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] Acquiring lock "192c3cd3-c610-4628-84df-0acd066b8970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] Lock "192c3cd3-c610-4628-84df-0acd066b8970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] No waiting events found dispatching network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:14:07 user nova-compute[75215]: WARNING nova.compute.manager [req-adb27b92-5f1a-44d9-9eef-cd10244f0930 req-dceac01f-538a-47e5-9b34-a2597eeb7931 service nova] [instance: 192c3cd3-c610-4628-84df-0acd066b8970] Received unexpected event network-vif-plugged-95d3f3c6-e91b-435a-8141-cd7162d78ad9 for instance with vm_state deleted and task_state None.
Nov 29 15:14:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:14:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:14:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:14:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:14:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:14:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:14:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=24.85602569580078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 43d93365-7e5f-49c2-aa53-73fbc002c3c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:14:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:14:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:14:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:14:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:15:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 36917fd7-1fb8-463b-95e9-affd4a46d3c4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:15:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:15:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:15:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:15:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:15:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:15:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:15:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:22 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:15:22 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=24.855186462402344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 43d93365-7e5f-49c2-aa53-73fbc002c3c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:15:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:15:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:15:23 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:15:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:15:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:15:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-changed-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Refreshing instance network info cache due to event network-changed-41fd8340-a195-464f-9f9a-c4eb8d6d6c89. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] Acquiring lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] Acquired lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Refreshing network info cache for port 41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updated VIF entry in instance network info cache for port 41fd8340-a195-464f-9f9a-c4eb8d6d6c89. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updating instance_info_cache with network_info: [{"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ac50d4e5-4a9d-4241-99a4-9e3c1bf8d879 req-39862806-09f2-4d3b-8c17-7fa715de2c98 service nova] Releasing lock "refresh_cache-43d93365-7e5f-49c2-aa53-73fbc002c3c2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:33 user nova-compute[75215]: INFO nova.compute.manager [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Terminating instance
Nov 29 15:15:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:15:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-unplugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] No waiting events found dispatching network-vif-unplugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-d22d4b5a-7d34-4fd9-a363-08afe6cf0d26 req-fcb2715c-d147-46ac-b04f-7a30dae81b3e service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-unplugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:15:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Instance destroyed successfully.
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid 43d93365-7e5f-49c2-aa53-73fbc002c3c2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2121049814',display_name='tempest-TestVolumeBootPattern-server-2121049814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2121049814',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-rcjzsbk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:13:55Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=43d93365-7e5f-49c2-aa53-73fbc002c3c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "address": "fa:16:3e:56:1c:56", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd8340-a1", "ovs_interfaceid": "41fd8340-a195-464f-9f9a-c4eb8d6d6c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_vif [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41fd8340-a1, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b313afb0-a78c-41ad-8c9f-0d9a16f00cc6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:34 user nova-compute[75215]: INFO os_vif [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:56,bridge_name='br-int',has_traffic_filtering=True,id=41fd8340-a195-464f-9f9a-c4eb8d6d6c89,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd8340-a1')
Nov 29 15:15:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:15:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4f782-30ac-485b-83be-6dd7a652b4cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:15:34 user nova-compute[75215]: No targets found.
Nov 29 15:15:34 user nova-compute[75215]: iSNS:
Nov 29 15:15:34 user nova-compute[75215]: No targets found.
Nov 29 15:15:34 user nova-compute[75215]: STATIC:
Nov 29 15:15:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:15:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:15:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:15:34 user nova-compute[75215]: FIRMWARE:
Nov 29 15:15:34 user nova-compute[75215]: No targets found.
Nov 29 15:15:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:15:34 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:15:34 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b04235-5663-488c-8183-6b7b7b4e27c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eed731-12e1-40d7-a360-09fd32003fbd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:15:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:15:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885abf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ebe28-7bb2-4633-901f-88c4cc9044ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb5ef1-dbca-40d7-b70d-ba46bb745df8]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.031s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc3e57-afe4-428d-8d1a-6f9b1b9227f4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:15:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.161s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a14c5d-3741-41e7-9b4e-dac7aaea3df0]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_59885779',) {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490e832-bad0-4037-811c-3a82d91f493b]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.054s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b389d792-0c4a-4880-be32-49419c866abf]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf153a-6ea7-4b86-86a0-6c69720dd308]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]
Nov 29 15:15:35 user nova-compute[75215]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.
Nov 29 15:15:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea28b8d-6211-4507-bf96-cc83df3efe8f]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (477ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:15:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Deleting instance files /opt/stack/data/nova/instances/43d93365-7e5f-49c2-aa53-73fbc002c3c2_del
Nov 29 15:15:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Deletion of /opt/stack/data/nova/instances/43d93365-7e5f-49c2-aa53-73fbc002c3c2_del complete
Nov 29 15:15:35 user nova-compute[75215]: INFO nova.compute.manager [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 29 15:15:35 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:15:35 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:15:36 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Took 0.84 seconds to deallocate network for instance.
Nov 29 15:15:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-856486ef-e309-454b-9ead-b6b45aa54f45 req-a639e425-b3d7-487b-8bec-a80576d8337d service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-deleted-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] Acquiring lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] No waiting events found dispatching network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:15:36 user nova-compute[75215]: WARNING nova.compute.manager [req-3036c89e-34d9-4cb7-8b54-5e1a75c229ce req-1f8859d7-9df6-4420-b66f-ffc22e6c66bb service nova] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Received unexpected event network-vif-plugged-41fd8340-a195-464f-9f9a-c4eb8d6d6c89 for instance with vm_state active and task_state deleting.
Nov 29 15:15:36 user nova-compute[75215]: INFO nova.compute.manager [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 43d93365-7e5f-49c2-aa53-73fbc002c3c2] Took 0.84 seconds to detach 1 volumes for instance.
Nov 29 15:15:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:15:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:15:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:37 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance 43d93365-7e5f-49c2-aa53-73fbc002c3c2
Nov 29 15:15:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e5a1be-7f52-4297-87e5-eae5041789d1 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "43d93365-7e5f-49c2-aa53-73fbc002c3c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-changed-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Refreshing instance network info cache due to event network-changed-820f549a-8f0a-47c2-84c4-f6358b023754. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Refreshing network info cache for port 820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updated VIF entry in instance network info cache for port 820f549a-8f0a-47c2-84c4-f6358b023754. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e262ae1-aa7d-44c1-84c1-d72653b80d9d req-59f7bfc2-6510-423d-abb7-1a4f4b2ba67e service nova] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:15:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:15:44 user nova-compute[75215]: INFO nova.compute.manager [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attaching volume fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb to /dev/vdb
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dded9cc-9111-4ef8-8f24-8f2ad9db6498]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89faeb48-24dc-4de0-a113-8a594cb0aa45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8c738-686d-41cc-8839-5f23b6249aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a54da4-729b-49d2-8bef-603d99283377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:15:45 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:15:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afe953-3ca7-4eae-8e21-70319c890241]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:15:45 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating existing volume attachment record: 3bcafa75-e00e-463b-9d47-c5f1b3f7fe78 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:15:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRkAUlGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:15:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:15:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:15:54 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[000468a7-90a1-451c-bed8-1ea31c91e536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:15:54 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[315cf772-aff8-43c9-bc43-a1a6550454a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb] added
Nov 29 15:15:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5d112d-e59a-4e38-a8c9-4848b221c50a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2532053-600b-4f48-a687-cd3ca31f1ae1]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRkAUlGh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRkAUlGh" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9aa5a-bd35-4b51-a266-91d61a3cbb7e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRkAUlGh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a99ed0-89d7-4e94-91fe-baa61c9b4fde]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53daa88-87ea-4cc1-8a3a-b24ca0ac7de5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:15:54 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:15:54 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:15:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:15:54 user nova-compute[75215]: 
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d1290b-82af-4767-aa95-a00811c54d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260]
Nov 29 15:15:54 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260] successful.
Nov 29 15:15:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03b269-6115-444b-8abe-27fca5ee6ac7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c07c19-479c-4bda-b7c9-bef47185ea63]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)
Nov 29 15:15:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)
Nov 29 15:15:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a94229-a626-4b7b-88c3-5edbd28559ef]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:15:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRkAUlGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23332316661633763', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332316661633763', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:15:56 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:15:56 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:15:56 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:15:56 user nova-compute[75215]:   <serial>fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb</serial>
Nov 29 15:15:56 user nova-compute[75215]: </disk>
Nov 29 15:15:56 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No VIF found with MAC fa:16:3e:a5:89:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:15:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84183791-0a7f-4735-aeef-683c0cb44dad tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.658s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:13 user nova-compute[75215]: INFO nova.compute.manager [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Detaching volume fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb
Nov 29 15:16:13 user nova-compute[75215]: INFO nova.virt.block_device [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attempting to driver detach volume fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb from mountpoint /dev/vdb
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Attempting to detach device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:16:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:16:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:16:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:16:13 user nova-compute[75215]:   <serial>fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb</serial>
Nov 29 15:16:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:16:13 user nova-compute[75215]: </disk>
Nov 29 15:16:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:16:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config.
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:16:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:16:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:16:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:16:13 user nova-compute[75215]:   <serial>fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb</serial>
Nov 29 15:16:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:16:13 user nova-compute[75215]: </disk>
Nov 29 15:16:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:16:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:16:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:16:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=24.85342788696289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:16:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:16:25 user nova-compute[75215]: INFO nova.compute.claims [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Claim successful on node user
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:16:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.policy [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:16:26 user nova-compute[75215]: INFO nova.virt.block_device [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Booting with volume 75240efe-3e1e-488b-800e-ce739c553a8f at /dev/vda
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03b8153-9423-4800-8089-6c044bbd8db4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e68301-2339-4b12-997f-0603ab52044a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[341d13e5-3fbf-4b19-b7c6-d98c7c0e4e9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caa24f8-855d-4ec0-b5a5-d476753722bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:16:26 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:16:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4267f3a4-aa16-4ca2-9382-05e6903ec163]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:16:26 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating existing volume attachment record: c698c682-0465-4757-a39f-b78bd2fd798d {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:16:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Successfully created port: 8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Successfully updated port: 8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing instance network info cache due to event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Instance network_info: |[{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updated VIF entry in instance network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-61b7ac0b-2297-49ce-8d40-6c6d7af66464 req-67dc6709-9b4d-4041-b33a-40028fc96f98 service nova] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:16:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:16:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 is timed out.
Nov 29 15:16:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config.
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRkAUlGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:16:33 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e2099-0253-4cd5-b67c-649814dd7528]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:16:33 user nova-compute[75215]: No targets found.
Nov 29 15:16:33 user nova-compute[75215]: iSNS:
Nov 29 15:16:33 user nova-compute[75215]: No targets found.
Nov 29 15:16:33 user nova-compute[75215]: STATIC:
Nov 29 15:16:33 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb
Nov 29 15:16:33 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:16:33 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:16:33 user nova-compute[75215]: FIRMWARE:
Nov 29 15:16:33 user nova-compute[75215]: No targets found.
Nov 29 15:16:33 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:16:33 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:16:33 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c5c1f-d797-4c2e-a66a-7d3416f97443]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db095159-fdd6-4405-9f72-3a91426d48bc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)
Nov 29 15:16:33 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb (non-flash)
Nov 29 15:16:33 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac689fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b741295-452a-4ea9-a292-bb4d08074f6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86621cd5-d59d-400b-aecd-7e4ec38cbad2]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5703a1d6-c141-4598-a4af-29bcc731a862]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:16:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Creating image(s)
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Ensure instance console log exists: /opt/stack/data/nova/instances/aff326f9-cefb-4a47-bcc7-b72d75371d7b/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Start _get_guest_xml network_info=[{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c698c682-0465-4757-a39f-b78bd2fd798d', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aff326f9-cefb-4a47-bcc7-b72d75371d7b', 'attached_at': '', 'detached_at': '', 'volume_id': '75240efe-3e1e-488b-800e-ce739c553a8f', 'serial': '75240efe-3e1e-488b-800e-ce739c553a8f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:16:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:16:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:16:33 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f611cb48-1ac7-49bc-a129-70b76091c551]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[be851ee1-24bf-406d-86fd-f90e15096f63]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a8514-8cf2-4075-9e55-2fee2a1177df]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260]
Nov 29 15:16:34 user nova-compute[75215]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb, portal: 172.16.0.220,3260] successful.
Nov 29 15:16:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1ad797-e3c3-4dd0-b0fe-3169ea4c2efb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a019f2a-da65-4f6a-bb18-7efb60f824c7]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== disconnect_volume: return (331ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.120s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:16:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:16:34 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9807093-6c6e-42a7-a341-c69a502dbc92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:16:34 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f2429-714a-446a-ac8f-857b3b180bd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f] added
Nov 29 15:16:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a5ca2-a5ef-4de9-9ba8-7ca53a354d15]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57fe1c-ba33-4950-8eea-35127f5a9d22]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBLotYQf {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBLotYQf" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba6887-3703-47f9-9476-e7c1ab76460c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBLotYQf'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555bc09-1076-4574-8512-4c31eca13174]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860932c-5574-4faf-8fac-3c0928025ddb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:16:34 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:16:34 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:16:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:16:34 user nova-compute[75215]: 
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94755957-4eea-4800-a10b-b73f88a48b49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]
Nov 29 15:16:34 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.
Nov 29 15:16:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a3eb6-3f67-4b53-977f-0b37837f7164]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7db91a-d3ab-4650-8bc8-e9d50a394356]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:16:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:16:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a57c1f-7c86-493a-8bd4-8b96f432ca86]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:16:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6f95b145-52d4-4733-8f45-8fd8dcfc3ed8 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26139323463343837', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139323463343837', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223030913',display_name='tempest-TestVolumeBootPattern-server-223030913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223030913',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-pudgdr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:16:26Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=aff326f9-cefb-4a47-bcc7-b72d75371d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid aff326f9-cefb-4a47-bcc7-b72d75371d7b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:16:35 user nova-compute[75215]:   <uuid>aff326f9-cefb-4a47-bcc7-b72d75371d7b</uuid>
Nov 29 15:16:35 user nova-compute[75215]:   <name>instance-00000030</name>
Nov 29 15:16:35 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:16:35 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:16:35 user nova-compute[75215]:   <metadata>
Nov 29 15:16:35 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:16:35 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:16:35 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-223030913</nova:name>
Nov 29 15:16:35 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:16:33</nova:creationTime>
Nov 29 15:16:35 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:16:35 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:16:35 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:16:35 user nova-compute[75215]:       <nova:owner>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:16:35 user nova-compute[75215]:       </nova:owner>
Nov 29 15:16:35 user nova-compute[75215]:       <nova:ports>
Nov 29 15:16:35 user nova-compute[75215]:         <nova:port uuid="8464e5c3-8883-460c-9531-1eb48bea4444">
Nov 29 15:16:35 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 15:16:35 user nova-compute[75215]:         </nova:port>
Nov 29 15:16:35 user nova-compute[75215]:       </nova:ports>
Nov 29 15:16:35 user nova-compute[75215]:     </nova:instance>
Nov 29 15:16:35 user nova-compute[75215]:   </metadata>
Nov 29 15:16:35 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:16:35 user nova-compute[75215]:     <system>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="serial">aff326f9-cefb-4a47-bcc7-b72d75371d7b</entry>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="uuid">aff326f9-cefb-4a47-bcc7-b72d75371d7b</entry>
Nov 29 15:16:35 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:16:35 user nova-compute[75215]:     </system>
Nov 29 15:16:35 user nova-compute[75215]:   </sysinfo>
Nov 29 15:16:35 user nova-compute[75215]:   <os>
Nov 29 15:16:35 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:16:35 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:16:35 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:16:35 user nova-compute[75215]:   </os>
Nov 29 15:16:35 user nova-compute[75215]:   <features>
Nov 29 15:16:35 user nova-compute[75215]:     <acpi/>
Nov 29 15:16:35 user nova-compute[75215]:     <apic/>
Nov 29 15:16:35 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:16:35 user nova-compute[75215]:   </features>
Nov 29 15:16:35 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:16:35 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:16:35 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:16:35 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:16:35 user nova-compute[75215]:   </clock>
Nov 29 15:16:35 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:16:35 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:16:35 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:16:35 user nova-compute[75215]:   </cpu>
Nov 29 15:16:35 user nova-compute[75215]:   <devices>
Nov 29 15:16:35 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:16:35 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:16:35 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:16:35 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:16:35 user nova-compute[75215]:       <serial>75240efe-3e1e-488b-800e-ce739c553a8f</serial>
Nov 29 15:16:35 user nova-compute[75215]:     </disk>
Nov 29 15:16:35 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:16:35 user nova-compute[75215]:       <mac address="fa:16:3e:5a:df:da"/>
Nov 29 15:16:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:16:35 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:16:35 user nova-compute[75215]:       <target dev="tap8464e5c3-88"/>
Nov 29 15:16:35 user nova-compute[75215]:     </interface>
Nov 29 15:16:35 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:16:35 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/aff326f9-cefb-4a47-bcc7-b72d75371d7b/console.log" append="off"/>
Nov 29 15:16:35 user nova-compute[75215]:     </serial>
Nov 29 15:16:35 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:16:35 user nova-compute[75215]:     <video>
Nov 29 15:16:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:16:35 user nova-compute[75215]:     </video>
Nov 29 15:16:35 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:16:35 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:16:35 user nova-compute[75215]:     </rng>
Nov 29 15:16:35 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:16:35 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:16:35 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:16:35 user nova-compute[75215]:     </memballoon>
Nov 29 15:16:35 user nova-compute[75215]:   </devices>
Nov 29 15:16:35 user nova-compute[75215]: </domain>
Nov 29 15:16:35 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223030913',display_name='tempest-TestVolumeBootPattern-server-223030913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223030913',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-pudgdr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:16:26Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=aff326f9-cefb-4a47-bcc7-b72d75371d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG os_vif [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c92182-10bc-5394-ab8c-7fe6d734bd35', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8464e5c3-88, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8464e5c3-88, col_values=(('qos', UUID('374ddd47-5d5d-4e68-844f-ad0fa31800d1')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8464e5c3-88, col_values=(('external_ids', {'iface-id': '8464e5c3-8883-460c-9531-1eb48bea4444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:df:da', 'vm-uuid': 'aff326f9-cefb-4a47-bcc7-b72d75371d7b'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:35 user nova-compute[75215]: INFO os_vif [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88')
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:16:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:5a:df:da, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:16:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] No waiting events found dispatching network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:16:37 user nova-compute[75215]: WARNING nova.compute.manager [req-56908330-3e1f-491a-b474-857628d6c1b6 req-ab9ce706-0cfe-485d-b030-4541ef228f3f service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received unexpected event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 for instance with vm_state building and task_state spawning.
Nov 29 15:16:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:16:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Instance spawned successfully.
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] No waiting events found dispatching network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:16:39 user nova-compute[75215]: WARNING nova.compute.manager [req-dfbc06de-5456-4d05-98b7-ae7db7c972ea req-63d52567-b0f3-47f4-a9ea-f2cc70f910a3 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received unexpected event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 for instance with vm_state building and task_state spawning.
Nov 29 15:16:39 user nova-compute[75215]: INFO nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 29 15:16:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:16:39 user nova-compute[75215]: INFO nova.compute.manager [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Took 13.51 seconds to build instance.
Nov 29 15:16:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-19b2ea85-b2cf-45a8-b121-280ca8c1553b tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.621s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:16:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:16:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:16:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:17:06 user nova-compute[75215]: INFO nova.compute.manager [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attaching volume b224d8ad-fb84-4b9b-8a3d-6af0047efb68 to /dev/vdb
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.utils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa0efc-85c7-4418-b4b1-f2a00f95612b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0440ecb-2677-4962-b47d-6bbe5b26bd71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[913bcb17-f080-40ff-b225-1af43636ff16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e22d45-0456-44ff-8250-7ca226428a3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:17:06 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:17:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab54e68-dae1-490e-babc-f574dd41dc15]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG os_brick.utils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:17:06 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating existing volume attachment record: cefeb75f-a997-4441-9b01-cbf2b61b30b7 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:17:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PztTXkFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:17:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:17:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:17:13 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1ab4f-b529-4500-ae83-e793b62e953d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:17:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b02e8b4-35dc-48b7-86e9-e66f9fda4188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68] added
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff16fef-3d0e-442d-8f0a-418ad5aebe49]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f6ff2-0645-41c7-8fab-cdcd09126fac]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PztTXkFs {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PztTXkFs" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1c043-038e-487f-bd7e-b4113b611f0b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PztTXkFs'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a2988-37ba-43e7-9030-677c3a06a691]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da442576-b58e-453f-ba2f-00608cdadbd2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea933c8-9928-49be-9271-ec311dbaad7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260]
Nov 29 15:17:13 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260] successful.
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1e269-8bea-466c-9607-aa71b2e9e499]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f585d18-5842-4f5a-a52f-ceae9c140a34]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:13 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:13 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)
Nov 29 15:17:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba55045-74dd-4c89-b5b3-29f8f952c777]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 36917fd7-1fb8-463b-95e9-affd4a46d3c4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PztTXkFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23535383665336536', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535383665336536', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:17:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:17:14 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:17:14 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:17:14 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:17:14 user nova-compute[75215]:   <serial>b224d8ad-fb84-4b9b-8a3d-6af0047efb68</serial>
Nov 29 15:17:14 user nova-compute[75215]: </disk>
Nov 29 15:17:14 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [{"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-36917fd7-1fb8-463b-95e9-affd4a46d3c4" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No VIF found with MAC fa:16:3e:a5:89:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-328e73bd-2e35-435f-8d5d-82797e254fd5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.059s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:17:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:17:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:17:17 user nova-compute[75215]: INFO nova.compute.manager [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Detaching volume b224d8ad-fb84-4b9b-8a3d-6af0047efb68
Nov 29 15:17:17 user nova-compute[75215]: INFO nova.virt.block_device [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attempting to driver detach volume b224d8ad-fb84-4b9b-8a3d-6af0047efb68 from mountpoint /dev/vdb
Nov 29 15:17:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Attempting to detach device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:17:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:17:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:17:17 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:17:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:17:17 user nova-compute[75215]:   <serial>b224d8ad-fb84-4b9b-8a3d-6af0047efb68</serial>
Nov 29 15:17:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:17:17 user nova-compute[75215]: </disk>
Nov 29 15:17:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:17:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config.
Nov 29 15:17:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:17:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:17:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:17:17 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:17:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:17:17 user nova-compute[75215]:   <serial>b224d8ad-fb84-4b9b-8a3d-6af0047efb68</serial>
Nov 29 15:17:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:17:17 user nova-compute[75215]: </disk>
Nov 29 15:17:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:17:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:17:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:17:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.843402862548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance aff326f9-cefb-4a47-bcc7-b72d75371d7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:17:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:17:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 is timed out.
Nov 29 15:17:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config.
Nov 29 15:17:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PztTXkFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:17:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7265c-05c0-420b-a41c-946cc23db908]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:17:38 user nova-compute[75215]: No targets found.
Nov 29 15:17:38 user nova-compute[75215]: iSNS:
Nov 29 15:17:38 user nova-compute[75215]: No targets found.
Nov 29 15:17:38 user nova-compute[75215]: STATIC:
Nov 29 15:17:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68
Nov 29 15:17:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:17:38 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:17:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:17:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:17:38 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:17:38 user nova-compute[75215]: FIRMWARE:
Nov 29 15:17:38 user nova-compute[75215]: No targets found.
Nov 29 15:17:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:17:38 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:17:38 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2412cf37-5f29-4681-808a-d02ac875ad14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7884deb-f8a9-4423-bb9e-1b5fbbe0d004]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:38 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)
Nov 29 15:17:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:17:38 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 (non-flash)
Nov 29 15:17:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cbc24d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5f700-324e-45df-9fc0-5d1dd63def92]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06434e-f4a5-4f7f-b8c6-e2567d0a153c]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0ea96d-1427-40b8-b37f-b13169d619b0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43770e-9958-4bca-93a3-42d309ad4dda]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd22d2d-362c-499f-9c09-70e6b703713c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a89833-1547-445f-9207-e2c9408f0c61]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260]
Nov 29 15:17:38 user nova-compute[75215]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68, portal: 172.16.0.220,3260] successful.
Nov 29 15:17:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b224d8ad-fb84-4b9b-8a3d-6af0047efb68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7515fb0d-8c11-4079-9890-3c3b55ce75a9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== disconnect_volume: return (314ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:17:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:17:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:17:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-50453bfd-511f-4598-9889-da33ea009bc2 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:17:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:17:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:17:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:18:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:18:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:11 user nova-compute[75215]: INFO nova.compute.manager [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attaching volume 0b387380-3593-44c4-a883-1a7188635079 to /dev/vdb
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8fe0d-300c-45ce-aaa5-51e9d7d59910]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ddb31e-4739-48a5-8c5e-5eae15ff6f25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2470ffd-44b5-478d-a9f5-4946db85c85f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2357a-a81e-4964-b491-ed73e841f199]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:18:11 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:18:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe178beb-36a3-4e31-be71-5b0cbb468170]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:18:11 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating existing volume attachment record: 11c8a4d3-ef61-4ce0-b812-e1651915a1a7 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:18:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:18:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:18:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:18:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing instance network info cache due to event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:18:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:18:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:18:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updated VIF entry in instance network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-943ed571-028d-4c96-b28a-1f77019ec8b1 req-d304ca7d-ce72-4888-bd21-b5b5d09e2daa service nova] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjoHWzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:18:18 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:18:18 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:18:18 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dbeeb7-2c21-4a7b-bdb0-9db5fd5ff2ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:18:18 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef9f07-b661-4053-8cc1-51130ab691d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079] added
Nov 29 15:18:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[785c254f-9e15-46aa-95aa-adb8bb2efab8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4c380-bc81-48b0-a4f8-1cf9e1b3efea]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUjoHWzG {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUjoHWzG" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b161d095-a47e-4846-96f6-336813734c50]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUjoHWzG'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dfe698-86d0-48eb-bf96-3288a259bcdc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c74fa9-f8f4-4e6c-a7bb-8b97a393bf87]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e6358-bc62-4e8e-9f67-4992cdce3688]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260]
Nov 29 15:18:18 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260] successful.
Nov 29 15:18:18 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c9bfde-112d-41e9-b46d-26070b7c7e1a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5991739-d793-4957-b14b-980c8fbfc761]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:19 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:19 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[96613653-9af0-44bd-b049-29eab44fa10e]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjoHWzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:18:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26361333739353664', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361333739353664', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.objects.instance [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:18:20 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:18:20 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:18:20 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:18:20 user nova-compute[75215]:   <serial>0b387380-3593-44c4-a883-1a7188635079</serial>
Nov 29 15:18:20 user nova-compute[75215]: </disk>
Nov 29 15:18:20 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No VIF found with MAC fa:16:3e:a5:89:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-edcf5104-8bb2-4bd8-8e64-a66e9798efb5 tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.467s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:22 user nova-compute[75215]: INFO nova.compute.manager [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Detaching volume 0b387380-3593-44c4-a883-1a7188635079
Nov 29 15:18:22 user nova-compute[75215]: INFO nova.virt.block_device [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attempting to driver detach volume 0b387380-3593-44c4-a883-1a7188635079 from mountpoint /dev/vdb
Nov 29 15:18:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Attempting to detach device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:18:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:18:22 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:18:22 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:18:22 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:18:22 user nova-compute[75215]:   <serial>0b387380-3593-44c4-a883-1a7188635079</serial>
Nov 29 15:18:22 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:18:22 user nova-compute[75215]: </disk>
Nov 29 15:18:22 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:18:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config.
Nov 29 15:18:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:18:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:18:22 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:18:22 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:18:22 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:18:22 user nova-compute[75215]:   <serial>0b387380-3593-44c4-a883-1a7188635079</serial>
Nov 29 15:18:22 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:18:22 user nova-compute[75215]: </disk>
Nov 29 15:18:22 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:18:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:18:26 user nova-compute[75215]: INFO nova.compute.claims [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Claim successful on node user
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:18:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=24.84206771850586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.184s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance aff326f9-cefb-4a47-bcc7-b72d75371d7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9b9429fa-fc17-45d8-9508-9c746a05f6b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:18:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:18:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:18:27 user nova-compute[75215]: INFO nova.virt.block_device [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Booting with volume c5135a54-42f5-493e-89a7-41630fc0f11d at /dev/vda
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.policy [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41cd5e511f7f41be8ca6cace8fffa2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732bef6e1c44fcab9ef85f5e9a0572b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc81c409-4a54-4423-b7c2-9a7e2bddf63c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afbf4f8-0642-4951-aadf-cf3e0452839a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8268ec-9a74-46e8-a152-2a0e6933e504]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd54b7a-7822-4d87-9c82-a506ec4ea0f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:18:27 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:18:27 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a2f41-92b0-4512-9523-76aaff63031a]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG os_brick.utils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating existing volume attachment record: da85e907-f5f4-4b3b-bd85-e768fc5b0908 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:18:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Successfully created port: c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Successfully updated port: c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquired lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing instance network info cache due to event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] Acquiring lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating instance_info_cache with network_info: [{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Releasing lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Instance network_info: |[{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] Acquired lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:18:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:18:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updated VIF entry in instance network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:18:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating instance_info_cache with network_info: [{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:18:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594f1487-09e3-4ff9-baef-4c63324e20fe req-9a9e7985-5bcc-4b79-b9f5-ddd83956b2f5 service nova] Releasing lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:18:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:18:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Creating image(s)
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Ensure instance console log exists: /opt/stack/data/nova/instances/9b9429fa-fc17-45d8-9508-9c746a05f6b5/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Start _get_guest_xml network_info=[{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'da85e907-f5f4-4b3b-bd85-e768fc5b0908', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdkpSGfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b9429fa-fc17-45d8-9508-9c746a05f6b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5135a54-42f5-493e-89a7-41630fc0f11d', 'serial': 'c5135a54-42f5-493e-89a7-41630fc0f11d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:18:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:18:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdkpSGfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:18:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:18:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:18:34 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5fd7f-08ea-475e-95af-0a5bed7540d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:18:34 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd1abdc-54c1-49c9-81d9-62483ba6a702]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d] added
Nov 29 15:18:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb380a1-2e93-4ce8-aa32-d827dec923e0]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[398d9638-0c9e-44d4-bf57-d87726452987]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdkpSGfh {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdkpSGfh" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a4e43-a08c-46a0-96ef-3642418e28d8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdkpSGfh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a54a9b-06b1-4d34-bbbc-8fd8c7e53d29]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf42a2-95ad-40a1-b27b-6fd3cfe366af]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f284ec-80ee-4ce5-9fe0-cba99466cf79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260]
Nov 29 15:18:35 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260] successful.
Nov 29 15:18:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[302c6bd9-dc38-4c6f-bcfe-c89e6ba2562e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297ea70-6ce9-4ee7-a05d-9cb9f52ca816]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:18:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:35 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:18:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37bf27-227b-49e8-baf6-f3cb08299570]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdkpSGfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:18:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23936313163356138', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936313163356138', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384015260',display_name='tempest-TestVolumeBootPattern-server-384015260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384015260',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-cl97yxv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:18:27Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=9b9429fa-fc17-45d8-9508-9c746a05f6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b9429fa-fc17-45d8-9508-9c746a05f6b5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:18:36 user nova-compute[75215]:   <uuid>9b9429fa-fc17-45d8-9508-9c746a05f6b5</uuid>
Nov 29 15:18:36 user nova-compute[75215]:   <name>instance-00000031</name>
Nov 29 15:18:36 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:18:36 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:18:36 user nova-compute[75215]:   <metadata>
Nov 29 15:18:36 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:18:36 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:18:36 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-384015260</nova:name>
Nov 29 15:18:36 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:18:34</nova:creationTime>
Nov 29 15:18:36 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:18:36 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:18:36 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:18:36 user nova-compute[75215]:       <nova:owner>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:user uuid="41cd5e511f7f41be8ca6cace8fffa2e4">tempest-TestVolumeBootPattern-288309841-project-member</nova:user>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:project uuid="5732bef6e1c44fcab9ef85f5e9a0572b">tempest-TestVolumeBootPattern-288309841</nova:project>
Nov 29 15:18:36 user nova-compute[75215]:       </nova:owner>
Nov 29 15:18:36 user nova-compute[75215]:       <nova:ports>
Nov 29 15:18:36 user nova-compute[75215]:         <nova:port uuid="c1bba493-943b-429b-8ea1-2f1514b84a88">
Nov 29 15:18:36 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 15:18:36 user nova-compute[75215]:         </nova:port>
Nov 29 15:18:36 user nova-compute[75215]:       </nova:ports>
Nov 29 15:18:36 user nova-compute[75215]:     </nova:instance>
Nov 29 15:18:36 user nova-compute[75215]:   </metadata>
Nov 29 15:18:36 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:18:36 user nova-compute[75215]:     <system>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="serial">9b9429fa-fc17-45d8-9508-9c746a05f6b5</entry>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="uuid">9b9429fa-fc17-45d8-9508-9c746a05f6b5</entry>
Nov 29 15:18:36 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:18:36 user nova-compute[75215]:     </system>
Nov 29 15:18:36 user nova-compute[75215]:   </sysinfo>
Nov 29 15:18:36 user nova-compute[75215]:   <os>
Nov 29 15:18:36 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:18:36 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:18:36 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:18:36 user nova-compute[75215]:   </os>
Nov 29 15:18:36 user nova-compute[75215]:   <features>
Nov 29 15:18:36 user nova-compute[75215]:     <acpi/>
Nov 29 15:18:36 user nova-compute[75215]:     <apic/>
Nov 29 15:18:36 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:18:36 user nova-compute[75215]:   </features>
Nov 29 15:18:36 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:18:36 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:18:36 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:18:36 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:18:36 user nova-compute[75215]:   </clock>
Nov 29 15:18:36 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:18:36 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:18:36 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:18:36 user nova-compute[75215]:   </cpu>
Nov 29 15:18:36 user nova-compute[75215]:   <devices>
Nov 29 15:18:36 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:18:36 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:18:36 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 29 15:18:36 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:18:36 user nova-compute[75215]:       <serial>c5135a54-42f5-493e-89a7-41630fc0f11d</serial>
Nov 29 15:18:36 user nova-compute[75215]:     </disk>
Nov 29 15:18:36 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:18:36 user nova-compute[75215]:       <mac address="fa:16:3e:47:b4:f5"/>
Nov 29 15:18:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:18:36 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:18:36 user nova-compute[75215]:       <target dev="tapc1bba493-94"/>
Nov 29 15:18:36 user nova-compute[75215]:     </interface>
Nov 29 15:18:36 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:18:36 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/9b9429fa-fc17-45d8-9508-9c746a05f6b5/console.log" append="off"/>
Nov 29 15:18:36 user nova-compute[75215]:     </serial>
Nov 29 15:18:36 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:18:36 user nova-compute[75215]:     <video>
Nov 29 15:18:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:18:36 user nova-compute[75215]:     </video>
Nov 29 15:18:36 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:18:36 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:18:36 user nova-compute[75215]:     </rng>
Nov 29 15:18:36 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:18:36 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:18:36 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:18:36 user nova-compute[75215]:     </memballoon>
Nov 29 15:18:36 user nova-compute[75215]:   </devices>
Nov 29 15:18:36 user nova-compute[75215]: </domain>
Nov 29 15:18:36 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384015260',display_name='tempest-TestVolumeBootPattern-server-384015260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384015260',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-cl97yxv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:18:27Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=9b9429fa-fc17-45d8-9508-9c746a05f6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG os_vif [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ac2a87d-8f8f-58ff-94c2-f42a29e4db30', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1bba493-94, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1bba493-94, col_values=(('qos', UUID('6871c6aa-0162-4017-ac9a-755959d8a426')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1bba493-94, col_values=(('external_ids', {'iface-id': 'c1bba493-943b-429b-8ea1-2f1514b84a88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:b4:f5', 'vm-uuid': '9b9429fa-fc17-45d8-9508-9c746a05f6b5'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:36 user nova-compute[75215]: INFO os_vif [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94')
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:18:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] No VIF found with MAC fa:16:3e:47:b4:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] No waiting events found dispatching network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:18:37 user nova-compute[75215]: WARNING nova.compute.manager [req-8751dd00-17b5-4d89-9880-7b15f1991d09 req-88498b56-e92c-4a89-a169-a30024af14bd service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received unexpected event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 for instance with vm_state building and task_state spawning.
Nov 29 15:18:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:18:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Instance spawned successfully.
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:18:39 user nova-compute[75215]: INFO nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] No waiting events found dispatching network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:18:39 user nova-compute[75215]: WARNING nova.compute.manager [req-7744e20d-1306-4521-9645-5674bc7e0951 req-90eb8a41-ae44-4d5d-b613-5d62ebf3b333 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received unexpected event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 for instance with vm_state building and task_state spawning.
Nov 29 15:18:39 user nova-compute[75215]: INFO nova.compute.manager [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Took 13.65 seconds to build instance.
Nov 29 15:18:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-af578887-1a0e-4348-b1a7-8a15ae6da653 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.910s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 is timed out.
Nov 29 15:18:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config.
Nov 29 15:18:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjoHWzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:18:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70e35e-0a46-429b-ab85-33869e7aaea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:18:42 user nova-compute[75215]: No targets found.
Nov 29 15:18:42 user nova-compute[75215]: iSNS:
Nov 29 15:18:42 user nova-compute[75215]: No targets found.
Nov 29 15:18:42 user nova-compute[75215]: STATIC:
Nov 29 15:18:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079
Nov 29 15:18:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:18:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:18:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d
Nov 29 15:18:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:18:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:18:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:18:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:18:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:18:42 user nova-compute[75215]: FIRMWARE:
Nov 29 15:18:42 user nova-compute[75215]: No targets found.
Nov 29 15:18:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:18:42 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:18:42 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732dea8-b9bd-45c3-82f1-884ddce9db1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5902a-f963-4694-a247-7d8a4f39272d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:42 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:42 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:18:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:18:42 user nova-compute[75215]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 (non-flash)
Nov 29 15:18:42 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:18:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c8838d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72848343-2539-41ff-8036-50ba1c62c116]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2943cb81-4934-4d33-bdd1-49acf0967807]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aadea6-1c5c-4274-8288-989e0ee7bfb2]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e47583b-384d-4e87-9b94-36c411513674]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd075f-0e96-49cd-9d6f-7a3e5797a8bc]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c75bbe-d262-4d91-b825-e00b4ef0cbc2]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260]
Nov 29 15:18:43 user nova-compute[75215]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079, portal: 172.16.0.220,3260] successful.
Nov 29 15:18:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b387380-3593-44c4-a883-1a7188635079 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd60bf1-ae38-4227-88a8-23fda4ac06e5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== disconnect_volume: return (294ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:18:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-05f4ed9f-f2ec-4ce0-bacf-243fea3ce2cc tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:18:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:18:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:18:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:10 user nova-compute[75215]: INFO nova.compute.manager [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Terminating instance
Nov 29 15:19:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-unplugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] No waiting events found dispatching network-vif-unplugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-8eacb426-d4b1-4f89-bf77-81269f793f33 req-ff8c5195-6ee6-468a-b88b-3b714960287c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-unplugged-e7f3339d-fbff-4a5e-9907-b93df1e452de for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Instance destroyed successfully.
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lazy-loading 'resources' on Instance uuid 36917fd7-1fb8-463b-95e9-affd4a46d3c4 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727154754',display_name='tempest-ServersNegativeTestJSON-server-1727154754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727154754',id=44,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d655981e000d4997aa5db8bc1d79dc5d',ramdisk_id='',reservation_id='r-niui3ihg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1652934373',owner_user_name='tempest-ServersNegativeTestJSON-1652934373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:10:30Z,user_data=None,user_id='e3b87f40b5f943debc89110626be29e3',uuid=36917fd7-1fb8-463b-95e9-affd4a46d3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converting VIF {"id": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "address": "fa:16:3e:4f:3c:65", "network": {"id": "32b3759e-983e-4a0f-b22f-9022fcdb689f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-534167996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d655981e000d4997aa5db8bc1d79dc5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f3339d-fb", "ovs_interfaceid": "e7f3339d-fbff-4a5e-9907-b93df1e452de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG os_vif [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f3339d-fb, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0118b8c-3841-48fd-b4e5-5562080df8ef) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:19:11 user nova-compute[75215]: INFO os_vif [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3c:65,bridge_name='br-int',has_traffic_filtering=True,id=e7f3339d-fbff-4a5e-9907-b93df1e452de,network=Network(32b3759e-983e-4a0f-b22f-9022fcdb689f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f3339d-fb')
Nov 29 15:19:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Deleting instance files /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4_del
Nov 29 15:19:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Deletion of /opt/stack/data/nova/instances/36917fd7-1fb8-463b-95e9-affd4a46d3c4_del complete
Nov 29 15:19:11 user nova-compute[75215]: INFO nova.compute.manager [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 15:19:11 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:19:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:19:12 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Took 0.51 seconds to deallocate network for instance.
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd36b022-a84b-4081-b9df-98eb951345ad req-764fde62-235d-4a7d-ad03-0fd3aa80533c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-deleted-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:19:12 user nova-compute[75215]: INFO nova.compute.manager [req-dd36b022-a84b-4081-b9df-98eb951345ad req-764fde62-235d-4a7d-ad03-0fd3aa80533c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Neutron deleted interface e7f3339d-fbff-4a5e-9907-b93df1e452de; detaching it from the instance and deleting it from the info cache
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-dd36b022-a84b-4081-b9df-98eb951345ad req-764fde62-235d-4a7d-ad03-0fd3aa80533c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-dd36b022-a84b-4081-b9df-98eb951345ad req-764fde62-235d-4a7d-ad03-0fd3aa80533c service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Detach interface failed, port_id=e7f3339d-fbff-4a5e-9907-b93df1e452de, reason: Instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:19:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:12 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Deleted allocations for instance 36917fd7-1fb8-463b-95e9-affd4a46d3c4
Nov 29 15:19:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26a9aa1d-96c8-44d9-a6a3-239fccd2e7c5 tempest-ServersNegativeTestJSON-1652934373 tempest-ServersNegativeTestJSON-1652934373-project-member] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:19:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] Acquiring lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] Lock "36917fd7-1fb8-463b-95e9-affd4a46d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] No waiting events found dispatching network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:19:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f88f0a08-fdef-473b-b17e-9d010815d4bc req-c966c09f-f948-446e-89dd-2abace14bd18 service nova] [instance: 36917fd7-1fb8-463b-95e9-affd4a46d3c4] Received unexpected event network-vif-plugged-e7f3339d-fbff-4a5e-9907-b93df1e452de for instance with vm_state deleted and task_state None.
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:15 user nova-compute[75215]: INFO nova.compute.manager [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attaching volume 151dc3e5-3dd3-4ec0-969f-7216a0d5c448 to /dev/vdb
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a03f99-4bdd-4b1f-a7c2-f399f6c9a999]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a65416e-17a2-495f-8717-d15e825a1516]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84520a3a-7688-4dac-aff3-62f22463d0c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbfb342-d02c-432c-964f-ff93afe838ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:19:15 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:19:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e95da-b1b7-4652-93a3-8e27afc7d1b3]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:19:15 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating existing volume attachment record: 08f8c5d5-6450-40ae-b42f-921d398d0c74 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:19:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:19:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDdzYLsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:19:22 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:19:22 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:19:22 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:19:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a7235-2bc6-4db2-a496-9365a6231bda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:19:22 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ef235-f158-4152-a836-81436502bf0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448] added
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce864f06-add9-48da-84a2-8dd040042510]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3325eb-8ac7-4ac8-9150-e9b616c22762]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDdzYLsV {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDdzYLsV" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b59a78-dedf-4d94-8fc5-901e74f8790d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDdzYLsV'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744608e-af36-49a1-8958-147536a1129b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd79a5-50e8-4d15-8230-8e6711b81983]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc70b66-e3b2-4205-898c-70196ded9007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260]
Nov 29 15:19:23 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260] successful.
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dfc978-c671-47c8-a639-0e2e47b8b176]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[501974b8-2a33-4420-9fda-ff151803e040]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:23 user nova-compute[75215]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)
Nov 29 15:19:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344a770-0b17-45c0-9281-eb7e56d03f17]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDdzYLsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23733343138633632', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733343138633632', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:19:24 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:19:24 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:19:24 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:19:24 user nova-compute[75215]:   <serial>151dc3e5-3dd3-4ec0-969f-7216a0d5c448</serial>
Nov 29 15:19:24 user nova-compute[75215]: </disk>
Nov 29 15:19:24 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] No VIF found with MAC fa:16:3e:a5:89:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:19:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2d07285d-7eec-4f4b-a31f-8d68c549038e tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.272s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:26 user nova-compute[75215]: INFO nova.compute.manager [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Detaching volume 151dc3e5-3dd3-4ec0-969f-7216a0d5c448
Nov 29 15:19:26 user nova-compute[75215]: INFO nova.virt.block_device [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Attempting to driver detach volume 151dc3e5-3dd3-4ec0-969f-7216a0d5c448 from mountpoint /dev/vdb
Nov 29 15:19:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Attempting to detach device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:19:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:19:26 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:19:26 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:19:26 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:19:26 user nova-compute[75215]:   <serial>151dc3e5-3dd3-4ec0-969f-7216a0d5c448</serial>
Nov 29 15:19:26 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:19:26 user nova-compute[75215]: </disk>
Nov 29 15:19:26 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:19:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the persistent domain config.
Nov 29 15:19:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:19:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:19:26 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:19:26 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 29 15:19:26 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:19:26 user nova-compute[75215]:   <serial>151dc3e5-3dd3-4ec0-969f-7216a0d5c448</serial>
Nov 29 15:19:26 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:19:26 user nova-compute[75215]: </disk>
Nov 29 15:19:26 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:19:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=24.867610931396484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance aff326f9-cefb-4a47-bcc7-b72d75371d7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 9b9429fa-fc17-45d8-9508-9c746a05f6b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:19:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:19:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Verify base images {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Image id e99e1aa5-1b15-43b4-b195-011929ff5a30 yields fingerprint a49917345d90067b486b1478fe5f6756119e246c {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] image e99e1aa5-1b15-43b4-b195-011929ff5a30 at (/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c): checking
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] image e99e1aa5-1b15-43b4-b195-011929ff5a30 at (/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c): image is in use {{(pid=75215) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] 14321ff4-a1f0-4c37-8288-caeec1849948 is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] 14321ff4-a1f0-4c37-8288-caeec1849948 has a disk file {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 is backed by a49917345d90067b486b1478fe5f6756119e246c {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] aff326f9-cefb-4a47-bcc7-b72d75371d7b is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] 9b9429fa-fc17-45d8-9508-9c746a05f6b5 is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93
Nov 29 15:19:46 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Active base files: /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Removable base files: /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8 /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327 /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24 /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155 /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93 /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/334b1b0f42a57c559d9cf03b27123fe149b06fb8
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8adb5bd2e069eb647c2243574d39046eabd39327
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/827312a0ea9750696828ef4dc856fb8d9282ba24
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/385af15bbf84b2b7c646faf456b494f4603e817e
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d310be72d8b00f197a97766e0ebebcb72c9d0155
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c6f7a582528dbf1ef409d8730b0bab36f7a37e93
Nov 29 15:19:46 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf2e9356beb1f4429dad2f6832272ed9df2c47a7
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Verification complete {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Verify swap images {{(pid=75215) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Verify ephemeral images {{(pid=75215) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 15:19:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:47 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14321ff4-a1f0-4c37-8288-caeec1849948 is timed out.
Nov 29 15:19:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully detached device vdb from instance 14321ff4-a1f0-4c37-8288-caeec1849948 from the live domain config.
Nov 29 15:19:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDdzYLsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:19:47 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be3618-dac9-4c34-a6fa-e544a4ec69b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:19:47 user nova-compute[75215]: No targets found.
Nov 29 15:19:47 user nova-compute[75215]: iSNS:
Nov 29 15:19:47 user nova-compute[75215]: No targets found.
Nov 29 15:19:47 user nova-compute[75215]: STATIC:
Nov 29 15:19:47 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d
Nov 29 15:19:47 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:19:47 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:19:47 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448
Nov 29 15:19:47 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:19:47 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:19:47 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:19:47 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:19:47 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:19:47 user nova-compute[75215]: FIRMWARE:
Nov 29 15:19:47 user nova-compute[75215]: No targets found.
Nov 29 15:19:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:19:47 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:19:47 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[913460fb-d387-4084-93b4-9e832c781df8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7eae78-1b50-4e46-84ce-c83a1ef15074]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:47 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:47 user nova-compute[75215]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)
Nov 29 15:19:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:19:47 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:19:47 user nova-compute[75215]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 (non-flash)
Nov 29 15:19:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88530790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca8338-7ee6-44ac-8988-55afc4ff6d47]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0486417f-0158-4695-989e-e2d3ad3524f0]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f381851-cb0b-4c76-aa60-55162d53373c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c66298-6fc0-4838-ae8b-674db6ac1460]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbbf43f-6b1b-4357-ae92-6da0c312a8be]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb7439-79b5-4bf4-8984-1c49290d8019]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260]
Nov 29 15:19:47 user nova-compute[75215]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448, portal: 172.16.0.220,3260] successful.
Nov 29 15:19:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151dc3e5-3dd3-4ec0-969f-7216a0d5c448 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde319c1-9610-4c97-86bb-1094221d3b83]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] <== disconnect_volume: return (319ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:19:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:19:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'flavor' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:19:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f44f6c76-5481-4886-99e2-83b6f8de699c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:19:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:19:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5012 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:20:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:20:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [{"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-14321ff4-a1f0-4c37-8288-caeec1849948" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:20:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:20:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing instance network info cache due to event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] Acquiring lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] Acquired lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updated VIF entry in instance network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating instance_info_cache with network_info: [{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57afabf5-bfa3-45f0-934a-8e7fa6641edb req-4d2a0fb3-5dd2-4df0-952b-788bda68244f service nova] Releasing lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:18 user nova-compute[75215]: INFO nova.compute.manager [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Terminating instance
Nov 29 15:20:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-unplugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] No waiting events found dispatching network-vif-unplugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-e37ad2df-aab1-4bda-8fa8-f31a07866cc4 req-2c55844c-243f-4d2d-947b-a2478213e954 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-unplugged-c1bba493-943b-429b-8ea1-2f1514b84a88 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Instance destroyed successfully.
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.objects.instance [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid 9b9429fa-fc17-45d8-9508-9c746a05f6b5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384015260',display_name='tempest-TestVolumeBootPattern-server-384015260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384015260',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-cl97yxv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:18:40Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=9b9429fa-fc17-45d8-9508-9c746a05f6b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_vif [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1bba493-94, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6871c6aa-0162-4017-ac9a-755959d8a426) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:19 user nova-compute[75215]: INFO os_vif [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=c1bba493-943b-429b-8ea1-2f1514b84a88,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1bba493-94')
Nov 29 15:20:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdkpSGfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:20:19 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e86e5f-8cb9-4ff1-8728-9dc77d2d3cf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:20:19 user nova-compute[75215]: No targets found.
Nov 29 15:20:19 user nova-compute[75215]: iSNS:
Nov 29 15:20:19 user nova-compute[75215]: No targets found.
Nov 29 15:20:19 user nova-compute[75215]: STATIC:
Nov 29 15:20:19 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d
Nov 29 15:20:19 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:20:19 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:20:19 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:20:19 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:20:19 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:20:19 user nova-compute[75215]: FIRMWARE:
Nov 29 15:20:19 user nova-compute[75215]: No targets found.
Nov 29 15:20:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:20:19 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:20:19 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3444a300-3f15-4bd7-8763-1cc36a4d7704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c60ad98-a427-4607-b9f7-101fb6542858]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:20:19 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:20:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:20:19 user nova-compute[75215]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d (non-flash)
Nov 29 15:20:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885bbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b0d534-abcb-4d3d-aeb3-f0819b4126d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f553afb1-c0f6-4b1d-885f-677eeb8efec7]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1365c-9104-4996-b040-c18545a67d06]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb03be-2c1e-42d8-8ff1-1b9c920c7358]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23936313163356138', '/dev/disk/by-id/scsi-1SCST_BIOd01fa419-9611c5a803898ab0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d01fa419') {{(pid=85827) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa68f1e-a825-4f59-8e66-e9a9764b4125]: (4, None) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a73ef4c-2f37-4372-b10a-133cd271da9a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:20:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c105366b-e6c0-4fc2-af78-8b5493f51639]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260]
Nov 29 15:20:20 user nova-compute[75215]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d, portal: 172.16.0.220,3260] successful.
Nov 29 15:20:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5135a54-42f5-493e-89a7-41630fc0f11d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f4a94-5142-4b7d-bc92-237934122cef]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (309ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:20:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Deleting instance files /opt/stack/data/nova/instances/9b9429fa-fc17-45d8-9508-9c746a05f6b5_del
Nov 29 15:20:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Deletion of /opt/stack/data/nova/instances/9b9429fa-fc17-45d8-9508-9c746a05f6b5_del complete
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing instance network info cache due to event network-changed-c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] Acquiring lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] Acquired lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Refreshing network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:20:20 user nova-compute[75215]: INFO nova.compute.manager [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updated VIF entry in instance network info cache for port c1bba493-943b-429b-8ea1-2f1514b84a88. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating instance_info_cache with network_info: [{"id": "c1bba493-943b-429b-8ea1-2f1514b84a88", "address": "fa:16:3e:47:b4:f5", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1bba493-94", "ovs_interfaceid": "c1bba493-943b-429b-8ea1-2f1514b84a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3b42d527-4456-4587-afed-11536d167074 req-5060e39e-eb94-4e39-9712-f465c84f673e service nova] Releasing lock "refresh_cache-9b9429fa-fc17-45d8-9508-9c746a05f6b5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:20:20 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:20 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Took 0.71 seconds to deallocate network for instance.
Nov 29 15:20:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] Acquiring lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] No waiting events found dispatching network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:20:21 user nova-compute[75215]: WARNING nova.compute.manager [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received unexpected event network-vif-plugged-c1bba493-943b-429b-8ea1-2f1514b84a88 for instance with vm_state active and task_state deleting.
Nov 29 15:20:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-ff3a63b5-6df3-4bb1-be31-657ae2df0c82 req-3313231f-c411-494b-ac35-25faa6f78e55 service nova] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Received event network-vif-deleted-c1bba493-943b-429b-8ea1-2f1514b84a88 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:21 user nova-compute[75215]: INFO nova.compute.manager [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: 9b9429fa-fc17-45d8-9508-9c746a05f6b5] Took 0.96 seconds to detach 1 volumes for instance.
Nov 29 15:20:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:20:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:20:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:22 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance 9b9429fa-fc17-45d8-9508-9c746a05f6b5
Nov 29 15:20:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00327a38-9761-41b2-8473-fbaefdead2c8 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "9b9429fa-fc17-45d8-9508-9c746a05f6b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:20:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:20:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:20:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:20:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:20:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=24.857669830322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 14321ff4-a1f0-4c37-8288-caeec1849948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance aff326f9-cefb-4a47-bcc7-b72d75371d7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:20:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid aff326f9-cefb-4a47-bcc7-b72d75371d7b {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:20:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:20:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:47 user nova-compute[75215]: INFO nova.compute.manager [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Terminating instance
Nov 29 15:20:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-unplugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] No waiting events found dispatching network-vif-unplugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-914facd4-623e-4cba-ae77-5f17b216a486 req-8b7a811b-ecea-427e-9298-e96fafa235ab service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-unplugged-820f549a-8f0a-47c2-84c4-f6358b023754 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:20:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Instance destroyed successfully.
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lazy-loading 'resources' on Instance uuid 14321ff4-a1f0-4c37-8288-caeec1849948 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-709367052',display_name='tempest-SnapshotDataIntegrityTests-server-709367052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-709367052',id=47,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0FrXD50XnX5UvlkCbFgg59GY+WMEwbEAr5Vn/00ateOlR2g4gvawwBcCzLNSWqH77WjdDzFRDLS7Sr+VnCyGyV1Q8ejhy5P3L4Lb+/Sha5lg97npAhhI+umduvx343A==',key_name='tempest-keypair-582796785',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41dba2522afe4249bc29b8a0983b6b2e',ramdisk_id='',reservation_id='r-f1dplm50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2097192493',owner_user_name='tempest-SnapshotDataIntegrityTests-2097192493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f9b399eea834505860648a3a3537ffd',uuid=14321ff4-a1f0-4c37-8288-caeec1849948,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converting VIF {"id": "820f549a-8f0a-47c2-84c4-f6358b023754", "address": "fa:16:3e:a5:89:9e", "network": {"id": "95cd84c5-8b92-435d-a818-eab7a955c93f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1633865570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41dba2522afe4249bc29b8a0983b6b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820f549a-8f", "ovs_interfaceid": "820f549a-8f0a-47c2-84c4-f6358b023754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG os_vif [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap820f549a-8f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60dc31a8-731d-4335-a726-f43e7f6dfe70) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:48 user nova-compute[75215]: INFO os_vif [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:89:9e,bridge_name='br-int',has_traffic_filtering=True,id=820f549a-8f0a-47c2-84c4-f6358b023754,network=Network(95cd84c5-8b92-435d-a818-eab7a955c93f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820f549a-8f')
Nov 29 15:20:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Deleting instance files /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948_del
Nov 29 15:20:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Deletion of /opt/stack/data/nova/instances/14321ff4-a1f0-4c37-8288-caeec1849948_del complete
Nov 29 15:20:48 user nova-compute[75215]: INFO nova.compute.manager [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 15:20:48 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:20:48 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:49 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Took 0.65 seconds to deallocate network for instance.
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-de26ef97-960c-49a7-8ee6-03b0c585894c req-cf5d1daf-1768-428f-ad89-ca307f4b8eb2 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-deleted-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:49 user nova-compute[75215]: INFO nova.compute.manager [req-de26ef97-960c-49a7-8ee6-03b0c585894c req-cf5d1daf-1768-428f-ad89-ca307f4b8eb2 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Neutron deleted interface 820f549a-8f0a-47c2-84c4-f6358b023754; detaching it from the instance and deleting it from the info cache
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-de26ef97-960c-49a7-8ee6-03b0c585894c req-cf5d1daf-1768-428f-ad89-ca307f4b8eb2 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-de26ef97-960c-49a7-8ee6-03b0c585894c req-cf5d1daf-1768-428f-ad89-ca307f4b8eb2 service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Detach interface failed, port_id=820f549a-8f0a-47c2-84c4-f6358b023754, reason: Instance 14321ff4-a1f0-4c37-8288-caeec1849948 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:20:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:49 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Deleted allocations for instance 14321ff4-a1f0-4c37-8288-caeec1849948
Nov 29 15:20:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ad82ceb-c2c4-4616-a794-f0803c2dbf4c tempest-SnapshotDataIntegrityTests-2097192493 tempest-SnapshotDataIntegrityTests-2097192493-project-member] Lock "14321ff4-a1f0-4c37-8288-caeec1849948" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.861s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:20:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] Acquiring lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:20:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:20:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] Lock "14321ff4-a1f0-4c37-8288-caeec1849948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:20:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] No waiting events found dispatching network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:20:50 user nova-compute[75215]: WARNING nova.compute.manager [req-174f80cc-10e0-451f-9fcc-7e7f0805bf10 req-f7a61203-2118-4105-b2bd-f20ba7b1b70e service nova] [instance: 14321ff4-a1f0-4c37-8288-caeec1849948] Received unexpected event network-vif-plugged-820f549a-8f0a-47c2-84c4-f6358b023754 for instance with vm_state deleted and task_state None.
Nov 29 15:20:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:20:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:21:04 user nova-compute[75215]: INFO nova.compute.claims [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Claim successful on node user
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:21:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:21:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:21:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Creating image(s)
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "/opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "/opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "/opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.policy [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f43c3ddaffd4a8da816a56e0c767346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109f1c1e4cf5400d96d7104e84b4c0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "a49917345d90067b486b1478fe5f6756119e246c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c,backing_fmt=raw /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk 1073741824" returned: 0 in 0.046s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "a49917345d90067b486b1478fe5f6756119e246c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49917345d90067b486b1478fe5f6756119e246c --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Cannot resize image /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Ensure instance console log exists: /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Successfully created port: e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Successfully updated port: e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquired lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-changed-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Refreshing instance network info cache due to event network-changed-e87680da-7200-4718-b244-28d4e18e7214. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] Acquiring lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Updating instance_info_cache with network_info: [{"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Releasing lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Instance network_info: |[{"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] Acquired lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.neutron [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Refreshing network info cache for port e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Start _get_guest_xml network_info=[{"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'e99e1aa5-1b15-43b4-b195-011929ff5a30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:21:06 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:21:06 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T14:40:15Z,direct_url=<?>,disk_format='qcow2',id=e99e1aa5-1b15-43b4-b195-011929ff5a30,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7aad691100f434d9e8dd445a9630e5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T14:40:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-758562203',display_name='tempest-VolumesNegativeTest-instance-758562203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-758562203',id=50,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109f1c1e4cf5400d96d7104e84b4c0fc',ramdisk_id='',reservation_id='r-sffhiohm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1730979364',owner_user_name='tempest-VolumesNegativeTest-1730979364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:21:05Z,user_data=None,user_id='7f43c3ddaffd4a8da816a56e0c767346',uuid=94d15dd6-9a40-4a59-b1f2-71976bd74755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converting VIF {"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lazy-loading 'pci_devices' on Instance uuid 94d15dd6-9a40-4a59-b1f2-71976bd74755 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:21:06 user nova-compute[75215]:   <uuid>94d15dd6-9a40-4a59-b1f2-71976bd74755</uuid>
Nov 29 15:21:06 user nova-compute[75215]:   <name>instance-00000032</name>
Nov 29 15:21:06 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:21:06 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:21:06 user nova-compute[75215]:   <metadata>
Nov 29 15:21:06 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:21:06 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:name>tempest-VolumesNegativeTest-instance-758562203</nova:name>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:21:06</nova:creationTime>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:21:06 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:21:06 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:owner>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:user uuid="7f43c3ddaffd4a8da816a56e0c767346">tempest-VolumesNegativeTest-1730979364-project-member</nova:user>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:project uuid="109f1c1e4cf5400d96d7104e84b4c0fc">tempest-VolumesNegativeTest-1730979364</nova:project>
Nov 29 15:21:06 user nova-compute[75215]:       </nova:owner>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:root type="image" uuid="e99e1aa5-1b15-43b4-b195-011929ff5a30"/>
Nov 29 15:21:06 user nova-compute[75215]:       <nova:ports>
Nov 29 15:21:06 user nova-compute[75215]:         <nova:port uuid="e87680da-7200-4718-b244-28d4e18e7214">
Nov 29 15:21:06 user nova-compute[75215]:           <nova:ip type="fixed" address="192.168.233.206" ipVersion="4"/>
Nov 29 15:21:06 user nova-compute[75215]:         </nova:port>
Nov 29 15:21:06 user nova-compute[75215]:       </nova:ports>
Nov 29 15:21:06 user nova-compute[75215]:     </nova:instance>
Nov 29 15:21:06 user nova-compute[75215]:   </metadata>
Nov 29 15:21:06 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:21:06 user nova-compute[75215]:     <system>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="serial">94d15dd6-9a40-4a59-b1f2-71976bd74755</entry>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="uuid">94d15dd6-9a40-4a59-b1f2-71976bd74755</entry>
Nov 29 15:21:06 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:21:06 user nova-compute[75215]:     </system>
Nov 29 15:21:06 user nova-compute[75215]:   </sysinfo>
Nov 29 15:21:06 user nova-compute[75215]:   <os>
Nov 29 15:21:06 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:21:06 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:21:06 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:21:06 user nova-compute[75215]:   </os>
Nov 29 15:21:06 user nova-compute[75215]:   <features>
Nov 29 15:21:06 user nova-compute[75215]:     <acpi/>
Nov 29 15:21:06 user nova-compute[75215]:     <apic/>
Nov 29 15:21:06 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:21:06 user nova-compute[75215]:   </features>
Nov 29 15:21:06 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:21:06 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:21:06 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:21:06 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:21:06 user nova-compute[75215]:   </clock>
Nov 29 15:21:06 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:21:06 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:21:06 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:21:06 user nova-compute[75215]:   </cpu>
Nov 29 15:21:06 user nova-compute[75215]:   <devices>
Nov 29 15:21:06 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:21:06 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:21:06 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk"/>
Nov 29 15:21:06 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:21:06 user nova-compute[75215]:     </disk>
Nov 29 15:21:06 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:21:06 user nova-compute[75215]:       <mac address="fa:16:3e:10:95:1c"/>
Nov 29 15:21:06 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:21:06 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:21:06 user nova-compute[75215]:       <target dev="tape87680da-72"/>
Nov 29 15:21:06 user nova-compute[75215]:     </interface>
Nov 29 15:21:06 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:21:06 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/console.log" append="off"/>
Nov 29 15:21:06 user nova-compute[75215]:     </serial>
Nov 29 15:21:06 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:21:06 user nova-compute[75215]:     <video>
Nov 29 15:21:06 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:21:06 user nova-compute[75215]:     </video>
Nov 29 15:21:06 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:21:06 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:21:06 user nova-compute[75215]:     </rng>
Nov 29 15:21:06 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:21:06 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:21:06 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:21:06 user nova-compute[75215]:     </memballoon>
Nov 29 15:21:06 user nova-compute[75215]:   </devices>
Nov 29 15:21:06 user nova-compute[75215]: </domain>
Nov 29 15:21:06 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-758562203',display_name='tempest-VolumesNegativeTest-instance-758562203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-758562203',id=50,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109f1c1e4cf5400d96d7104e84b4c0fc',ramdisk_id='',reservation_id='r-sffhiohm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1730979364',owner_user_name='tempest-VolumesNegativeTest-1730979364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:21:05Z,user_data=None,user_id='7f43c3ddaffd4a8da816a56e0c767346',uuid=94d15dd6-9a40-4a59-b1f2-71976bd74755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converting VIF {"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG os_vif [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae8dd438-16bb-579e-8d38-69fb5276d89d', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87680da-72, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape87680da-72, col_values=(('qos', UUID('3a248b84-6d3b-4e23-a5a3-df50e284dfea')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape87680da-72, col_values=(('external_ids', {'iface-id': 'e87680da-7200-4718-b244-28d4e18e7214', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:95:1c', 'vm-uuid': '94d15dd6-9a40-4a59-b1f2-71976bd74755'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:06 user nova-compute[75215]: INFO os_vif [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72')
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:21:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] No VIF found with MAC fa:16:3e:10:95:1c, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:21:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Updated VIF entry in instance network info cache for port e87680da-7200-4718-b244-28d4e18e7214. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:21:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Updating instance_info_cache with network_info: [{"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:21:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef39de12-59cd-4097-bd43-f07b72e6a639 req-1089420f-8b5e-4361-8eec-1bd97aa38950 service nova] Releasing lock "refresh_cache-94d15dd6-9a40-4a59-b1f2-71976bd74755" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] No waiting events found dispatching network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:21:08 user nova-compute[75215]: WARNING nova.compute.manager [req-5374fd86-5963-4696-8cba-62c3f7c01788 req-3260478e-7803-47ef-87e4-b8d36b4ec77c service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received unexpected event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 for instance with vm_state building and task_state spawning.
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:21:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Instance spawned successfully.
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:21:10 user nova-compute[75215]: INFO nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:21:10 user nova-compute[75215]: INFO nova.compute.manager [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Took 5.97 seconds to build instance.
Nov 29 15:21:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-189b3a69-d32b-4207-ad61-f76d35c846de tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.066s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] No waiting events found dispatching network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:21:10 user nova-compute[75215]: WARNING nova.compute.manager [req-94ef1a3c-229c-4089-be00-af818b23f433 req-ba96dfc6-5807-43a5-b54b-8742ffa434dc service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received unexpected event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 for instance with vm_state active and task_state None.
Nov 29 15:21:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing instance network info cache due to event network-changed-8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] Acquiring lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:18 user nova-compute[75215]: INFO nova.compute.manager [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Terminating instance
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] Acquired lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Refreshing network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:21:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-unplugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] No waiting events found dispatching network-vif-unplugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a022399-2f71-4a83-ab69-a19433b03795 req-63cf8b16-1d7f-4c2a-b8e0-815d08faeb62 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-unplugged-8464e5c3-8883-460c-9531-1eb48bea4444 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:19 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Instance destroyed successfully.
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lazy-loading 'resources' on Instance uuid aff326f9-cefb-4a47-bcc7-b72d75371d7b {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223030913',display_name='tempest-TestVolumeBootPattern-server-223030913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223030913',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZpbwLSd9JI5MJd2aoJTtWLrRMa0AEVOuXtujaQPWB+H5dt8b6uvFXvbw5ccWTCJMqIw3ijbLErNl/Sq4LMKZf2Evwn9E1TuszULQ1kh8r6w3Yjsw9pETkBrzO8XZmj5A==',key_name='tempest-TestVolumeBootPattern-461730612',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5732bef6e1c44fcab9ef85f5e9a0572b',ramdisk_id='',reservation_id='r-pudgdr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-288309841',owner_user_name='tempest-TestVolumeBootPattern-288309841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:16:39Z,user_data=None,user_id='41cd5e511f7f41be8ca6cace8fffa2e4',uuid=aff326f9-cefb-4a47-bcc7-b72d75371d7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converting VIF {"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_vif [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8464e5c3-88, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=374ddd47-5d5d-4e68-844f-ad0fa31800d1) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updated VIF entry in instance network info cache for port 8464e5c3-8883-460c-9531-1eb48bea4444. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [{"id": "8464e5c3-8883-460c-9531-1eb48bea4444", "address": "fa:16:3e:5a:df:da", "network": {"id": "e34fc3bf-403f-446b-8965-7a77674ba009", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-249352081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5732bef6e1c44fcab9ef85f5e9a0572b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8464e5c3-88", "ovs_interfaceid": "8464e5c3-8883-460c-9531-1eb48bea4444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:19 user nova-compute[75215]: INFO os_vif [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:df:da,bridge_name='br-int',has_traffic_filtering=True,id=8464e5c3-8883-460c-9531-1eb48bea4444,network=Network(e34fc3bf-403f-446b-8965-7a77674ba009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8464e5c3-88')
Nov 29 15:21:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBLotYQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:21:19 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc92e948-ccad-40ce-ad34-229e997ae6a0 req-60bfc511-c267-4175-84b0-dbee7b096cb1 service nova] Releasing lock "refresh_cache-aff326f9-cefb-4a47-bcc7-b72d75371d7b" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1c62b-fb38-471e-9b9a-77a18fcc7d7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:21:19 user nova-compute[75215]: No targets found.
Nov 29 15:21:19 user nova-compute[75215]: iSNS:
Nov 29 15:21:19 user nova-compute[75215]: No targets found.
Nov 29 15:21:19 user nova-compute[75215]: STATIC:
Nov 29 15:21:19 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f
Nov 29 15:21:19 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:21:19 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:21:19 user nova-compute[75215]: FIRMWARE:
Nov 29 15:21:19 user nova-compute[75215]: No targets found.
Nov 29 15:21:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:21:19 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:21:19 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[342dedfb-005a-4c87-a150-37df4ca867af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0d383-49fa-4b29-a0f0-a93e7eb9dc1d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:21:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f (non-flash)
Nov 29 15:21:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c88456cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d54fa-335d-46ce-afc6-24ebd8bce8f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33238cb9-c6f6-4792-8e4d-7a0b3d6448c9]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cd148-4363-49b5-b01e-94d6ce6b4ca4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c33142-5192-43df-bd0b-10c24bb5fe18]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ced19-5af0-4f47-8f02-54a2611c1027]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:21:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4354ee7-7ec7-478e-abc1-157654738bab]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260]
Nov 29 15:21:20 user nova-compute[75215]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f, portal: 172.16.0.220,3260] successful.
Nov 29 15:21:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75240efe-3e1e-488b-800e-ce739c553a8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c303d63-f27f-486c-a8a0-84d315eb6c6e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] <== disconnect_volume: return (349ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:21:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Deleting instance files /opt/stack/data/nova/instances/aff326f9-cefb-4a47-bcc7-b72d75371d7b_del
Nov 29 15:21:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Deletion of /opt/stack/data/nova/instances/aff326f9-cefb-4a47-bcc7-b72d75371d7b_del complete
Nov 29 15:21:20 user nova-compute[75215]: INFO nova.compute.manager [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 15:21:20 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:21:20 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:21:20 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Took 0.42 seconds to deallocate network for instance.
Nov 29 15:21:21 user nova-compute[75215]: INFO nova.compute.manager [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] Acquiring lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] No waiting events found dispatching network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:21:21 user nova-compute[75215]: WARNING nova.compute.manager [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received unexpected event network-vif-plugged-8464e5c3-8883-460c-9531-1eb48bea4444 for instance with vm_state deleted and task_state None.
Nov 29 15:21:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-dc372d23-8b9e-470f-8d22-f0a10f644bed req-d6a5b2c1-c573-41b5-b1a7-8299fc6c9445 service nova] [instance: aff326f9-cefb-4a47-bcc7-b72d75371d7b] Received event network-vif-deleted-8464e5c3-8883-460c-9531-1eb48bea4444 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:21 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Deleted allocations for instance aff326f9-cefb-4a47-bcc7-b72d75371d7b
Nov 29 15:21:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6cfb0c3a-184a-4959-9bfa-f7a8de9738c9 tempest-TestVolumeBootPattern-288309841 tempest-TestVolumeBootPattern-288309841-project-member] Lock "aff326f9-cefb-4a47-bcc7-b72d75371d7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:21:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:21:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:21:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.856178283691406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 94d15dd6-9a40-4a59-b1f2-71976bd74755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:21:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:21:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:21:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:21:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:22:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:22:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:22:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:22:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:22:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:22:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.844524383544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 94d15dd6-9a40-4a59-b1f2-71976bd74755 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:22:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:22:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:54 user nova-compute[75215]: INFO nova.compute.manager [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Terminating instance
Nov 29 15:22:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-unplugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] No waiting events found dispatching network-vif-unplugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-206b6675-2e38-46a6-9cc1-1db100f05271 req-38de724b-75ca-473e-b3b1-c9ea7d356271 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-unplugged-e87680da-7200-4718-b244-28d4e18e7214 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:22:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Instance destroyed successfully.
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.objects.instance [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lazy-loading 'resources' on Instance uuid 94d15dd6-9a40-4a59-b1f2-71976bd74755 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-758562203',display_name='tempest-VolumesNegativeTest-instance-758562203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-758562203',id=50,image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109f1c1e4cf5400d96d7104e84b4c0fc',ramdisk_id='',reservation_id='r-sffhiohm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e99e1aa5-1b15-43b4-b195-011929ff5a30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1730979364',owner_user_name='tempest-VolumesNegativeTest-1730979364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:21:11Z,user_data=None,user_id='7f43c3ddaffd4a8da816a56e0c767346',uuid=94d15dd6-9a40-4a59-b1f2-71976bd74755,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converting VIF {"id": "e87680da-7200-4718-b244-28d4e18e7214", "address": "fa:16:3e:10:95:1c", "network": {"id": "0fe720bb-89ac-4474-b342-be102466d71a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7aad691100f434d9e8dd445a9630e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87680da-72", "ovs_interfaceid": "e87680da-7200-4718-b244-28d4e18e7214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG os_vif [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87680da-72, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a248b84-6d3b-4e23-a5a3-df50e284dfea) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:22:55 user nova-compute[75215]: INFO os_vif [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=e87680da-7200-4718-b244-28d4e18e7214,network=Network(0fe720bb-89ac-4474-b342-be102466d71a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87680da-72')
Nov 29 15:22:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Deleting instance files /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755_del
Nov 29 15:22:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Deletion of /opt/stack/data/nova/instances/94d15dd6-9a40-4a59-b1f2-71976bd74755_del complete
Nov 29 15:22:55 user nova-compute[75215]: INFO nova.compute.manager [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 15:22:55 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:22:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:22:56 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:22:56 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Took 0.50 seconds to deallocate network for instance.
Nov 29 15:22:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:56 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:22:56 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:22:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:56 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Deleted allocations for instance 94d15dd6-9a40-4a59-b1f2-71976bd74755
Nov 29 15:22:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cbf79177-e4ec-4946-9557-b058945ea649 tempest-VolumesNegativeTest-1730979364 tempest-VolumesNegativeTest-1730979364-project-member] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:22:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] Acquiring lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:22:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:22:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] Lock "94d15dd6-9a40-4a59-b1f2-71976bd74755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:22:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] No waiting events found dispatching network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:22:57 user nova-compute[75215]: WARNING nova.compute.manager [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received unexpected event network-vif-plugged-e87680da-7200-4718-b244-28d4e18e7214 for instance with vm_state deleted and task_state None.
Nov 29 15:22:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-712a737c-a47a-42ac-9b62-c4e1fe83db60 req-3f1b4a8c-108e-4153-84b8-233565c1a769 service nova] [instance: 94d15dd6-9a40-4a59-b1f2-71976bd74755] Received event network-vif-deleted-e87680da-7200-4718-b244-28d4e18e7214 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:23:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:23:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:23:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:23:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:23:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:23:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:23:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9208MB free_disk=24.870967864990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:23:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:23:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:23:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:23:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:23:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:23:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:23:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:23:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:23:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:24:10 user nova-compute[75215]: INFO nova.compute.claims [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Claim successful on node user
Nov 29 15:24:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:24:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.policy [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '461c47805db04f9ba7ad4a3898dacc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab09c1fec95d4633b23da4822d4b85db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:24:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Creating image(s)
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Successfully created port: 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.part --force-share --output=json" returned: 0 in 0.307s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.virt.images [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] dd6b1ebd-4186-48fe-b44b-70d198f7ff9f was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.part /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.part /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.converted" returned: 0 in 0.289s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.283s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Successfully updated port: 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing instance network info cache due to event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5,backing_fmt=raw /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5,backing_fmt=raw /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance network_info: |[{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json" returned: 0 in 0.165s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Cannot resize image /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Ensure instance console log exists: /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start _get_guest_xml network_info=[{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T15:24:08Z,direct_url=<?>,disk_format='qcow2',id=dd6b1ebd-4186-48fe-b44b-70d198f7ff9f,min_disk=0,min_ram=0,name='tempest-scenario-img--1684893331',owner='ab09c1fec95d4633b23da4822d4b85db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T15:24:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'dd6b1ebd-4186-48fe-b44b-70d198f7ff9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:24:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:24:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T15:24:08Z,direct_url=<?>,disk_format='qcow2',id=dd6b1ebd-4186-48fe-b44b-70d198f7ff9f,min_disk=0,min_ram=0,name='tempest-scenario-img--1684893331',owner='ab09c1fec95d4633b23da4822d4b85db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T15:24:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:24:11Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:24:13 user nova-compute[75215]:   <uuid>8dae8657-4e1b-4cd5-93bc-42d08d3761ab</uuid>
Nov 29 15:24:13 user nova-compute[75215]:   <name>instance-00000033</name>
Nov 29 15:24:13 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:24:13 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:24:13 user nova-compute[75215]:   <metadata>
Nov 29 15:24:13 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:24:13 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1316484107</nova:name>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:24:13</nova:creationTime>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:24:13 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:24:13 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:owner>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:user uuid="461c47805db04f9ba7ad4a3898dacc96">tempest-TestMinimumBasicScenario-1672366294-project-member</nova:user>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:project uuid="ab09c1fec95d4633b23da4822d4b85db">tempest-TestMinimumBasicScenario-1672366294</nova:project>
Nov 29 15:24:13 user nova-compute[75215]:       </nova:owner>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:root type="image" uuid="dd6b1ebd-4186-48fe-b44b-70d198f7ff9f"/>
Nov 29 15:24:13 user nova-compute[75215]:       <nova:ports>
Nov 29 15:24:13 user nova-compute[75215]:         <nova:port uuid="0dfc66a4-8f61-4e5a-9861-730787d20934">
Nov 29 15:24:13 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 15:24:13 user nova-compute[75215]:         </nova:port>
Nov 29 15:24:13 user nova-compute[75215]:       </nova:ports>
Nov 29 15:24:13 user nova-compute[75215]:     </nova:instance>
Nov 29 15:24:13 user nova-compute[75215]:   </metadata>
Nov 29 15:24:13 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:24:13 user nova-compute[75215]:     <system>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="serial">8dae8657-4e1b-4cd5-93bc-42d08d3761ab</entry>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="uuid">8dae8657-4e1b-4cd5-93bc-42d08d3761ab</entry>
Nov 29 15:24:13 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:24:13 user nova-compute[75215]:     </system>
Nov 29 15:24:13 user nova-compute[75215]:   </sysinfo>
Nov 29 15:24:13 user nova-compute[75215]:   <os>
Nov 29 15:24:13 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:24:13 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:24:13 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:24:13 user nova-compute[75215]:   </os>
Nov 29 15:24:13 user nova-compute[75215]:   <features>
Nov 29 15:24:13 user nova-compute[75215]:     <acpi/>
Nov 29 15:24:13 user nova-compute[75215]:     <apic/>
Nov 29 15:24:13 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:24:13 user nova-compute[75215]:   </features>
Nov 29 15:24:13 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:24:13 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:24:13 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:24:13 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:24:13 user nova-compute[75215]:   </clock>
Nov 29 15:24:13 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:24:13 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:24:13 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:24:13 user nova-compute[75215]:   </cpu>
Nov 29 15:24:13 user nova-compute[75215]:   <devices>
Nov 29 15:24:13 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:24:13 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:24:13 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk"/>
Nov 29 15:24:13 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:24:13 user nova-compute[75215]:     </disk>
Nov 29 15:24:13 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:24:13 user nova-compute[75215]:       <mac address="fa:16:3e:51:aa:3a"/>
Nov 29 15:24:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:24:13 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:24:13 user nova-compute[75215]:       <target dev="tap0dfc66a4-8f"/>
Nov 29 15:24:13 user nova-compute[75215]:     </interface>
Nov 29 15:24:13 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:24:13 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/console.log" append="off"/>
Nov 29 15:24:13 user nova-compute[75215]:     </serial>
Nov 29 15:24:13 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:24:13 user nova-compute[75215]:     <video>
Nov 29 15:24:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:24:13 user nova-compute[75215]:     </video>
Nov 29 15:24:13 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:24:13 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:24:13 user nova-compute[75215]:     </rng>
Nov 29 15:24:13 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:24:13 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:24:13 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:24:13 user nova-compute[75215]:     </memballoon>
Nov 29 15:24:13 user nova-compute[75215]:   </devices>
Nov 29 15:24:13 user nova-compute[75215]: </domain>
Nov 29 15:24:13 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:24:11Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG os_vif [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a63f744-a205-5222-bd16-637e72c92e29', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dfc66a4-8f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dfc66a4-8f, col_values=(('qos', UUID('90c19696-ae41-46eb-88f7-79ea0047f817')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dfc66a4-8f, col_values=(('external_ids', {'iface-id': '0dfc66a4-8f61-4e5a-9861-730787d20934', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:aa:3a', 'vm-uuid': '8dae8657-4e1b-4cd5-93bc-42d08d3761ab'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:13 user nova-compute[75215]: INFO os_vif [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f')
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated VIF entry in instance network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-058f9f36-556a-4ea0-a00a-1dfedb50f276 req-bb4ed807-c00e-4232-8c2f-611b02239d9c service nova] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:24:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No VIF found with MAC fa:16:3e:51:aa:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:24:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:24:15 user nova-compute[75215]: WARNING nova.compute.manager [req-dafd8b0c-a05c-4ea7-8190-10b5b6b4b0be req-d61ddaab-78f1-4875-ac29-27a837031c4a service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state building and task_state spawning.
Nov 29 15:24:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:24:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance spawned successfully.
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:24:17 user nova-compute[75215]: INFO nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 29 15:24:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:24:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:24:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:24:17 user nova-compute[75215]: WARNING nova.compute.manager [req-ce6bcac3-a758-4b92-903f-bd4411665372 req-2af7c23a-85a4-4360-91af-645b6bc8370f service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state active and task_state None.
Nov 29 15:24:17 user nova-compute[75215]: INFO nova.compute.manager [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Took 6.31 seconds to build instance.
Nov 29 15:24:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc03978b-54a3-446a-9032-603b232e824c tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:24:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:24:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:24:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:24:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:24:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:24:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=24.807083129882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:24:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:24:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:24:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:24:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:24:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:25:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:25:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:25:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:25:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:25:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:25:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:25:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:25:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.778751373291016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:25:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:25:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:25:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:25:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:25:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:25:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:25:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:25:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:26:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:04 user nova-compute[75215]: INFO nova.compute.manager [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Attaching volume 48209978-57f5-4868-af58-17c40d3ecc8a to /dev/vdb
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.utils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0244b9-7e52-44f0-81d9-cc1885aabdda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4026ab0-142d-4f9b-aaa3-08607a81db35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acbdf2a-b7f2-4b7f-9fab-4e3d80159fa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83b5dd7-a450-45c6-bd30-b55e0aaa13e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:26:04 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:26:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcee06b-924d-49d3-b794-7475bbb94e48]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG os_brick.utils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:26:04 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating existing volume attachment record: 3cd1e929-1950-4dd2-b42d-07c12f0967b5 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:26:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:26:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:26:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:26:11 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa3151-57ae-4193-a33c-6e3422f92c93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:26:11 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5923f7c8-51dc-41d9-a007-e26b2afc5290]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a] added
Nov 29 15:26:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ced2e-8eb0-4821-88e6-c5a48bc3eab8]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27daddb-c3a0-40c4-8e4b-70eaf06ad8ab]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uALKpDNM {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uALKpDNM" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d82343-85c3-4ca4-87b3-77f306c60206]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uALKpDNM'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ed7bd-98a4-416d-bced-f5a7e0d47548]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf0f85-2e8d-4f44-9e68-ff7085234dd8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:26:11 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:26:11 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:26:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:26:11 user nova-compute[75215]: 
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b87de4-1749-40c3-831a-16ab8a3c4861]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]
Nov 29 15:26:11 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.
Nov 29 15:26:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e02222-c3d6-4615-a83b-892a1d225b39]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e5375-42c6-4f4b-bfb5-7e997ac73b2a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e21ef0-3b24-4bad-9311-06bdb1017425]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:26:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26537303937373361', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537303937373361', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:26:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:26:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:26:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:26:13 user nova-compute[75215]:   <serial>48209978-57f5-4868-af58-17c40d3ecc8a</serial>
Nov 29 15:26:13 user nova-compute[75215]: </disk>
Nov 29 15:26:13 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No VIF found with MAC fa:16:3e:51:aa:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c122be7-a106-4733-a2d6-2fb0ef63fd0a tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.012s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing instance network info cache due to event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:26:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:26:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated VIF entry in instance network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:26:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:26:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee6b592e-07c7-4e58-9790-f74b488f4da4 req-ea2224a5-01e7-4d73-bbef-579e3abd7d96 service nova] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:26:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing instance network info cache due to event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated VIF entry in instance network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:26:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-39cd8586-4064-4b83-bf88-417e719c2c85 req-e35263ae-71ab-427c-8506-db364e50a4f9 service nova] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:26:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:29 user nova-compute[75215]: INFO nova.compute.manager [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Rebooting instance
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:26:30 user nova-compute[75215]: WARNING nova.compute.manager [req-0e4725b1-ea41-4cbe-a9b8-88d7fa8a3bbf req-6baebc71-7c1a-49d2-80fd-00df4270fd97 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance destroyed successfully.
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'resources' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:26:30Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dfc66a4-8f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90c19696-ae41-46eb-88f7-79ea0047f817) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:30 user nova-compute[75215]: INFO os_vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f')
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:26:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d97fa1-9e7d-4fd4-bb92-51d8a63d4d33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:26:30 user nova-compute[75215]: No targets found.
Nov 29 15:26:30 user nova-compute[75215]: iSNS:
Nov 29 15:26:30 user nova-compute[75215]: No targets found.
Nov 29 15:26:30 user nova-compute[75215]: STATIC:
Nov 29 15:26:30 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a
Nov 29 15:26:30 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:26:30 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:26:30 user nova-compute[75215]: FIRMWARE:
Nov 29 15:26:30 user nova-compute[75215]: No targets found.
Nov 29 15:26:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:26:30 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:26:30 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f4b897-3e36-4b17-8a0c-2ed5d6d94953]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b4845-e1bf-443d-a549-42cb60e18f75]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c8859eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b371f0-5e36-4d1e-88d8-8cd2b0ed00d4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122131e-d764-4f18-889d-12c0bf6d234d]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af6600-8a91-44b4-88f8-c13f789b35f9]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327d8a3-470f-4f14-b237-2ae17ec44b20]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222ea13-8d92-4b59-b32b-0a0905c286cd]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e522461d-0886-4b43-b765-b9b7c3ab552f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]
Nov 29 15:26:30 user nova-compute[75215]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.
Nov 29 15:26:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e676f-a4fe-4369-87b9-180bf1336e29]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== disconnect_volume: return (309ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start _get_guest_xml network_info=[{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd6b1ebd-4186-48fe-b44b-70d198f7ff9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': 'dd6b1ebd-4186-48fe-b44b-70d198f7ff9f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3cd1e929-1950-4dd2-b42d-07c12f0967b5', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8dae8657-4e1b-4cd5-93bc-42d08d3761ab', 'attached_at': '', 'detached_at': '', 'volume_id': '48209978-57f5-4868-af58-17c40d3ecc8a', 'serial': '48209978-57f5-4868-af58-17c40d3ecc8a'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:26:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:26:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd6b1ebd-4186-48fe-b44b-70d198f7ff9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:30 user nova-compute[75215]: DEBUG nova.objects.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Object Instance<8dae8657-4e1b-4cd5-93bc-42d08d3761ab> lazy-loaded attributes: resources,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:26:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:26:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:26:31 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d6cf5-ca0b-44ca-bfaa-2c8116d25ee5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:26:31 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c5ec3-3f04-411a-b5c7-29564e15b2d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a] added
Nov 29 15:26:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28135cc6-885b-4dd0-9184-a2085439d71a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d94c8-e8c1-4709-97b2-e7eaa8dd9373]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uALKpDNM {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uALKpDNM" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea88ca-1a18-4f21-95d3-9f4c87238afb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uALKpDNM'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b172fd-696a-4784-b2ab-f7afc88ce15c]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[608ee490-9357-412d-9894-013865bc81de]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:26:31 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:26:31 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:26:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:26:31 user nova-compute[75215]: 
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a6d99f-48b7-42e4-879f-887cf6d26362]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]
Nov 29 15:26:31 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.
Nov 29 15:26:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d17a958-11dc-43a3-afea-dc8931c6549a]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce3e1e-10c6-4eae-afda-490b3785f2de]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:26:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[00595bc3-b121-48a7-b059-c0e5d49bff27]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:26:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:26:32 user nova-compute[75215]: WARNING nova.compute.manager [req-e5ffc099-f3dd-4b12-aff6-82092a0762a0 req-1727455c-f95f-49ae-8eba-7ef77cab1536 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 15:26:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26537303937373361', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537303937373361', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:26:30Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.objects.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Object Instance<8dae8657-4e1b-4cd5-93bc-42d08d3761ab> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:26:32 user nova-compute[75215]:   <uuid>8dae8657-4e1b-4cd5-93bc-42d08d3761ab</uuid>
Nov 29 15:26:32 user nova-compute[75215]:   <name>instance-00000033</name>
Nov 29 15:26:32 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:26:32 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:26:32 user nova-compute[75215]:   <metadata>
Nov 29 15:26:32 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:26:32 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1316484107</nova:name>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:26:30</nova:creationTime>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:26:32 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:26:32 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:owner>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:user uuid="461c47805db04f9ba7ad4a3898dacc96">tempest-TestMinimumBasicScenario-1672366294-project-member</nova:user>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:project uuid="ab09c1fec95d4633b23da4822d4b85db">tempest-TestMinimumBasicScenario-1672366294</nova:project>
Nov 29 15:26:32 user nova-compute[75215]:       </nova:owner>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:root type="image" uuid="dd6b1ebd-4186-48fe-b44b-70d198f7ff9f"/>
Nov 29 15:26:32 user nova-compute[75215]:       <nova:ports>
Nov 29 15:26:32 user nova-compute[75215]:         <nova:port uuid="0dfc66a4-8f61-4e5a-9861-730787d20934">
Nov 29 15:26:32 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 15:26:32 user nova-compute[75215]:         </nova:port>
Nov 29 15:26:32 user nova-compute[75215]:       </nova:ports>
Nov 29 15:26:32 user nova-compute[75215]:     </nova:instance>
Nov 29 15:26:32 user nova-compute[75215]:   </metadata>
Nov 29 15:26:32 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:26:32 user nova-compute[75215]:     <system>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="serial">8dae8657-4e1b-4cd5-93bc-42d08d3761ab</entry>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="uuid">8dae8657-4e1b-4cd5-93bc-42d08d3761ab</entry>
Nov 29 15:26:32 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:26:32 user nova-compute[75215]:     </system>
Nov 29 15:26:32 user nova-compute[75215]:   </sysinfo>
Nov 29 15:26:32 user nova-compute[75215]:   <os>
Nov 29 15:26:32 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:26:32 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:26:32 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:26:32 user nova-compute[75215]:   </os>
Nov 29 15:26:32 user nova-compute[75215]:   <features>
Nov 29 15:26:32 user nova-compute[75215]:     <acpi/>
Nov 29 15:26:32 user nova-compute[75215]:     <apic/>
Nov 29 15:26:32 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:26:32 user nova-compute[75215]:   </features>
Nov 29 15:26:32 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:26:32 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:26:32 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:26:32 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:26:32 user nova-compute[75215]:   </clock>
Nov 29 15:26:32 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:26:32 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:26:32 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:26:32 user nova-compute[75215]:   </cpu>
Nov 29 15:26:32 user nova-compute[75215]:   <devices>
Nov 29 15:26:32 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:26:32 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:26:32 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk"/>
Nov 29 15:26:32 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:26:32 user nova-compute[75215]:     </disk>
Nov 29 15:26:32 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 29 15:26:32 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:26:32 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 29 15:26:32 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 29 15:26:32 user nova-compute[75215]:       <serial>48209978-57f5-4868-af58-17c40d3ecc8a</serial>
Nov 29 15:26:32 user nova-compute[75215]:     </disk>
Nov 29 15:26:32 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:26:32 user nova-compute[75215]:       <mac address="fa:16:3e:51:aa:3a"/>
Nov 29 15:26:32 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:26:32 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:26:32 user nova-compute[75215]:       <target dev="tap0dfc66a4-8f"/>
Nov 29 15:26:32 user nova-compute[75215]:     </interface>
Nov 29 15:26:32 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:26:32 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/console.log" append="off"/>
Nov 29 15:26:32 user nova-compute[75215]:     </serial>
Nov 29 15:26:32 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:26:32 user nova-compute[75215]:     <video>
Nov 29 15:26:32 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:26:32 user nova-compute[75215]:     </video>
Nov 29 15:26:32 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:26:32 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:26:32 user nova-compute[75215]:     </rng>
Nov 29 15:26:32 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:26:32 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:26:32 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:26:32 user nova-compute[75215]:     </memballoon>
Nov 29 15:26:32 user nova-compute[75215]:   </devices>
Nov 29 15:26:32 user nova-compute[75215]: </domain>
Nov 29 15:26:32 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:26:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.381s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:26:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9178MB free_disk=24.777122497558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.objects.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Object Instance<8dae8657-4e1b-4cd5-93bc-42d08d3761ab> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c59b2f0b5f00a5f56892d4250c5e1b3ced8ebd5 --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Cannot resize image /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'migration_context' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.objects.base [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Object Instance<8dae8657-4e1b-4cd5-93bc-42d08d3761ab> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:26:30Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG os_vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a63f744-a205-5222-bd16-637e72c92e29', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dfc66a4-8f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dfc66a4-8f, col_values=(('qos', UUID('2ca40c37-79d5-44c1-aec1-57c43004cc96')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dfc66a4-8f, col_values=(('external_ids', {'iface-id': '0dfc66a4-8f61-4e5a-9861-730787d20934', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:aa:3a', 'vm-uuid': '8dae8657-4e1b-4cd5-93bc-42d08d3761ab'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:26:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:33 user nova-compute[75215]: INFO os_vif [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f')
Nov 29 15:26:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:26:35 user nova-compute[75215]: WARNING nova.compute.manager [req-4b9b8805-d0d7-4248-bcec-90338dc90a86 req-2e93e036-39b9-4e6a-badc-b1d54c1aae29 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 15:26:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:26:37 user nova-compute[75215]: WARNING nova.compute.manager [req-57ac73c8-7bcf-445d-947c-408761e803bc req-f6014dbd-e16e-416c-88dd-d0cce250b7c2 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 15:26:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:26:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance rebooted successfully.
Nov 29 15:26:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:26:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-70739058-6d1b-4a36-859a-31143c2847ba tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.127s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:26:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:26:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:26:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:26:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:27:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:27:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:27:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:27:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:27:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.775794982910156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:27:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:27:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:27:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:27:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:27:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:27:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing instance network info cache due to event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated VIF entry in instance network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:28:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6401b86c-45c1-44b0-a2a4-139f08d261dd req-ce088488-3686-43b8-b275-d009a1d0f2a3 service nova] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:28:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:28:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:28:22 user nova-compute[75215]: INFO nova.compute.manager [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Detaching volume 48209978-57f5-4868-af58-17c40d3ecc8a
Nov 29 15:28:22 user nova-compute[75215]: INFO nova.virt.block_device [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Attempting to driver detach volume 48209978-57f5-4868-af58-17c40d3ecc8a from mountpoint /dev/vdb
Nov 29 15:28:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Attempting to detach device vdb from instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:28:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:28:22 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:28:22 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:28:22 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:28:22 user nova-compute[75215]:   <serial>48209978-57f5-4868-af58-17c40d3ecc8a</serial>
Nov 29 15:28:22 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 15:28:22 user nova-compute[75215]: </disk>
Nov 29 15:28:22 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:28:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully detached device vdb from instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab from the persistent domain config.
Nov 29 15:28:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:28:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:28:22 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:28:22 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:28:22 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:28:22 user nova-compute[75215]:   <serial>48209978-57f5-4868-af58-17c40d3ecc8a</serial>
Nov 29 15:28:22 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 15:28:22 user nova-compute[75215]: </disk>
Nov 29 15:28:22 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:28:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing instance network info cache due to event network-changed-0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Refreshing network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated VIF entry in instance network info cache for port 0dfc66a4-8f61-4e5a-9861-730787d20934. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bba77a36-266a-409b-a76c-2bc4ab1418a7 req-a264715a-9f3f-4edb-a292-28a7843818fd service nova] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:28:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [{"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-8dae8657-4e1b-4cd5-93bc-42d08d3761ab" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:28:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:28:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:28:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:28:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.767234802246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:28:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:28:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab is timed out.
Nov 29 15:28:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully detached device vdb from instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab from the live domain config.
Nov 29 15:28:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uALKpDNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:28:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d8514e-158b-44f7-8490-137b2ec1c34a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:28:42 user nova-compute[75215]: No targets found.
Nov 29 15:28:42 user nova-compute[75215]: iSNS:
Nov 29 15:28:42 user nova-compute[75215]: No targets found.
Nov 29 15:28:42 user nova-compute[75215]: STATIC:
Nov 29 15:28:42 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a
Nov 29 15:28:42 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:28:42 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:28:42 user nova-compute[75215]: FIRMWARE:
Nov 29 15:28:42 user nova-compute[75215]: No targets found.
Nov 29 15:28:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:28:42 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:28:42 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a06594b-2af7-48b3-86c0-b5d2efce81f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ccf5f2-5da3-4727-80cc-075a79676cae]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:28:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a (non-flash)
Nov 29 15:28:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4cac3ab9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf375ebc-2fa3-4af4-a5d8-17cdcabb1b96]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d0f68-14f8-4dea-97c2-d62405d179ef]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe5e2ca-68f6-4be8-86a9-85dd3f98ca3b]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc242af-ef9b-4828-9567-a47650efacbd]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e599d19-d386-4571-a188-d10905582dfa]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c875360-35d5-48c7-8475-56cee63d9f6b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260]
Nov 29 15:28:42 user nova-compute[75215]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a, portal: 172.16.0.220,3260] successful.
Nov 29 15:28:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48209978-57f5-4868-af58-17c40d3ecc8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c9285-3a67-407b-8687-b8c0fd55014d]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== disconnect_volume: return (302ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:28:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f5e426c8-eada-45ad-b7c5-822a0e6ed962 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:28:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:28:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:29:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:15 user nova-compute[75215]: INFO nova.compute.manager [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Terminating instance
Nov 29 15:29:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b222d3fe-3512-4f39-9872-8c3f8f33f4cd req-264a80a5-90f6-4bfe-bad6-c06fd3f3a1d9 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-unplugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:29:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Instance destroyed successfully.
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'resources' on Instance uuid 8dae8657-4e1b-4cd5-93bc-42d08d3761ab {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1316484107',display_name='tempest-TestMinimumBasicScenario-server-1316484107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1316484107',id=51,image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3WxkKkW7yupR4x8V/UXYRBF4USjbXaI5Q7hYAi/C2F0+LwTuPzDU8Tzhd4/UhE0GsgihbzdfP/UKixyJxrVypSeaTQ+AWBHMTtDZPea/fC0Ied4aU4Nt9LnWbLY5eFg==',key_name='tempest-TestMinimumBasicScenario-834000329',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-v7e99yqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd6b1ebd-4186-48fe-b44b-70d198f7ff9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:26:37Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=8dae8657-4e1b-4cd5-93bc-42d08d3761ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "0dfc66a4-8f61-4e5a-9861-730787d20934", "address": "fa:16:3e:51:aa:3a", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dfc66a4-8f", "ovs_interfaceid": "0dfc66a4-8f61-4e5a-9861-730787d20934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG os_vif [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dfc66a4-8f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ca40c37-79d5-44c1-aec1-57c43004cc96) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:16 user nova-compute[75215]: INFO os_vif [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:aa:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dfc66a4-8f61-4e5a-9861-730787d20934,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dfc66a4-8f')
Nov 29 15:29:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Deleting instance files /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab_del
Nov 29 15:29:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Deletion of /opt/stack/data/nova/instances/8dae8657-4e1b-4cd5-93bc-42d08d3761ab_del complete
Nov 29 15:29:16 user nova-compute[75215]: INFO nova.compute.manager [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 15:29:16 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:29:16 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:29:17 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Took 0.71 seconds to deallocate network for instance.
Nov 29 15:29:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-984f8951-7051-4299-8b67-e1e27c4276c8 req-e2f3988f-faf5-4237-830c-c70b365a0088 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-deleted-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:29:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:17 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Deleted allocations for instance 8dae8657-4e1b-4cd5-93bc-42d08d3761ab
Nov 29 15:29:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bc5bc898-18a9-4f49-93f5-810dc81eb017 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:29:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] Acquiring lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] Lock "8dae8657-4e1b-4cd5-93bc-42d08d3761ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] No waiting events found dispatching network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:29:18 user nova-compute[75215]: WARNING nova.compute.manager [req-bd63ce1a-24d7-4d99-930c-0a62011bc3d6 req-474065de-4a16-47ab-82e2-c97ed24c1c27 service nova] [instance: 8dae8657-4e1b-4cd5-93bc-42d08d3761ab] Received unexpected event network-vif-plugged-0dfc66a4-8f61-4e5a-9861-730787d20934 for instance with vm_state deleted and task_state None.
Nov 29 15:29:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:29:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:29:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:29:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:29:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9213MB free_disk=24.794586181640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:29:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:29:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 15:30:09 user nova-compute[75215]: INFO nova.compute.claims [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Claim successful on node user
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 15:30:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 15:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.policy [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '461c47805db04f9ba7ad4a3898dacc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab09c1fec95d4633b23da4822d4b85db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 15:30:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Creating image(s)
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "/opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "/opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "59e3a153cdcca305365abf4153e5b88d934e1d25" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "59e3a153cdcca305365abf4153e5b88d934e1d25" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.part --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.virt.images [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] 7ab691a3-3d62-45e5-ad09-6cf148c1b243 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.part /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Successfully created port: 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.part /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.converted" returned: 0 in 0.273s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "59e3a153cdcca305365abf4153e5b88d934e1d25" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.128s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "59e3a153cdcca305365abf4153e5b88d934e1d25" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "59e3a153cdcca305365abf4153e5b88d934e1d25" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Successfully updated port: 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing instance network info cache due to event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25,backing_fmt=raw /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25,backing_fmt=raw /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk 1073741824" returned: 0 in 0.049s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "59e3a153cdcca305365abf4153e5b88d934e1d25" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98ba1f78-4d29-4014-b962-31a8b2539bf4 req-5083b117-8aa6-4ef9-962b-7d745353b5ce service nova] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59e3a153cdcca305365abf4153e5b88d934e1d25 --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Cannot resize image /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 15:30:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Ensure instance console log exists: /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance network_info: |[{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Start _get_guest_xml network_info=[{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T15:30:07Z,direct_url=<?>,disk_format='qcow2',id=7ab691a3-3d62-45e5-ad09-6cf148c1b243,min_disk=0,min_ram=0,name='tempest-scenario-img--156507546',owner='ab09c1fec95d4633b23da4822d4b85db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T15:30:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'image_id': '7ab691a3-3d62-45e5-ad09-6cf148c1b243'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 15:30:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:30:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T14:40:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T15:30:07Z,direct_url=<?>,disk_format='qcow2',id=7ab691a3-3d62-45e5-ad09-6cf148c1b243,min_disk=0,min_ram=0,name='tempest-scenario-img--156507546',owner='ab09c1fec95d4633b23da4822d4b85db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T15:30:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1313315679',display_name='tempest-TestMinimumBasicScenario-server-1313315679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1313315679',id=52,image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtbc9tu5BKq9jXDeOaGc0BlhxQrIkAYWAgVJqWCqlhxdk5VcRYUiSn1O9Dx2JfhptcarY4cTW6b3hKtuC6t/JEyixGuPyrf7Ab5xkt6ZMH3uBWjWDdAVJDy3V+e3BmWQ==',key_name='tempest-TestMinimumBasicScenario-616111826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-c7jj4978',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:30:10Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=0dd89aef-3e72-4e04-b0bb-63be3d003138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] End _get_guest_xml xml=<domain type="kvm">
Nov 29 15:30:12 user nova-compute[75215]:   <uuid>0dd89aef-3e72-4e04-b0bb-63be3d003138</uuid>
Nov 29 15:30:12 user nova-compute[75215]:   <name>instance-00000034</name>
Nov 29 15:30:12 user nova-compute[75215]:   <memory>524288</memory>
Nov 29 15:30:12 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 29 15:30:12 user nova-compute[75215]:   <metadata>
Nov 29 15:30:12 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 15:30:12 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1313315679</nova:name>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:creationTime>2023-11-29 15:30:12</nova:creationTime>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 29 15:30:12 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 29 15:30:12 user nova-compute[75215]:       </nova:flavor>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:owner>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:user uuid="461c47805db04f9ba7ad4a3898dacc96">tempest-TestMinimumBasicScenario-1672366294-project-member</nova:user>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:project uuid="ab09c1fec95d4633b23da4822d4b85db">tempest-TestMinimumBasicScenario-1672366294</nova:project>
Nov 29 15:30:12 user nova-compute[75215]:       </nova:owner>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:root type="image" uuid="7ab691a3-3d62-45e5-ad09-6cf148c1b243"/>
Nov 29 15:30:12 user nova-compute[75215]:       <nova:ports>
Nov 29 15:30:12 user nova-compute[75215]:         <nova:port uuid="469a31ea-f0e3-4ce1-9a5a-54bf4261b413">
Nov 29 15:30:12 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 15:30:12 user nova-compute[75215]:         </nova:port>
Nov 29 15:30:12 user nova-compute[75215]:       </nova:ports>
Nov 29 15:30:12 user nova-compute[75215]:     </nova:instance>
Nov 29 15:30:12 user nova-compute[75215]:   </metadata>
Nov 29 15:30:12 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 29 15:30:12 user nova-compute[75215]:     <system>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="serial">0dd89aef-3e72-4e04-b0bb-63be3d003138</entry>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="uuid">0dd89aef-3e72-4e04-b0bb-63be3d003138</entry>
Nov 29 15:30:12 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 29 15:30:12 user nova-compute[75215]:     </system>
Nov 29 15:30:12 user nova-compute[75215]:   </sysinfo>
Nov 29 15:30:12 user nova-compute[75215]:   <os>
Nov 29 15:30:12 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 15:30:12 user nova-compute[75215]:     <boot dev="hd"/>
Nov 29 15:30:12 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 29 15:30:12 user nova-compute[75215]:   </os>
Nov 29 15:30:12 user nova-compute[75215]:   <features>
Nov 29 15:30:12 user nova-compute[75215]:     <acpi/>
Nov 29 15:30:12 user nova-compute[75215]:     <apic/>
Nov 29 15:30:12 user nova-compute[75215]:     <vmcoreinfo/>
Nov 29 15:30:12 user nova-compute[75215]:   </features>
Nov 29 15:30:12 user nova-compute[75215]:   <clock offset="utc">
Nov 29 15:30:12 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 15:30:12 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 15:30:12 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 29 15:30:12 user nova-compute[75215]:   </clock>
Nov 29 15:30:12 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 29 15:30:12 user nova-compute[75215]:     <model>Nehalem</model>
Nov 29 15:30:12 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 15:30:12 user nova-compute[75215]:   </cpu>
Nov 29 15:30:12 user nova-compute[75215]:   <devices>
Nov 29 15:30:12 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 29 15:30:12 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 15:30:12 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk"/>
Nov 29 15:30:12 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 29 15:30:12 user nova-compute[75215]:     </disk>
Nov 29 15:30:12 user nova-compute[75215]:     <interface type="ethernet">
Nov 29 15:30:12 user nova-compute[75215]:       <mac address="fa:16:3e:fb:13:46"/>
Nov 29 15:30:12 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:30:12 user nova-compute[75215]:       <mtu size="1442"/>
Nov 29 15:30:12 user nova-compute[75215]:       <target dev="tap469a31ea-f0"/>
Nov 29 15:30:12 user nova-compute[75215]:     </interface>
Nov 29 15:30:12 user nova-compute[75215]:     <serial type="pty">
Nov 29 15:30:12 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/console.log" append="off"/>
Nov 29 15:30:12 user nova-compute[75215]:     </serial>
Nov 29 15:30:12 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 15:30:12 user nova-compute[75215]:     <video>
Nov 29 15:30:12 user nova-compute[75215]:       <model type="virtio"/>
Nov 29 15:30:12 user nova-compute[75215]:     </video>
Nov 29 15:30:12 user nova-compute[75215]:     <rng model="virtio">
Nov 29 15:30:12 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 29 15:30:12 user nova-compute[75215]:     </rng>
Nov 29 15:30:12 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 29 15:30:12 user nova-compute[75215]:     <memballoon model="virtio">
Nov 29 15:30:12 user nova-compute[75215]:       <stats period="10"/>
Nov 29 15:30:12 user nova-compute[75215]:     </memballoon>
Nov 29 15:30:12 user nova-compute[75215]:   </devices>
Nov 29 15:30:12 user nova-compute[75215]: </domain>
Nov 29 15:30:12 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1313315679',display_name='tempest-TestMinimumBasicScenario-server-1313315679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1313315679',id=52,image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtbc9tu5BKq9jXDeOaGc0BlhxQrIkAYWAgVJqWCqlhxdk5VcRYUiSn1O9Dx2JfhptcarY4cTW6b3hKtuC6t/JEyixGuPyrf7Ab5xkt6ZMH3uBWjWDdAVJDy3V+e3BmWQ==',key_name='tempest-TestMinimumBasicScenario-616111826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-c7jj4978',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T15:30:10Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=0dd89aef-3e72-4e04-b0bb-63be3d003138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG os_vif [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0af55f6b-d850-5bcc-a6a3-644c20c3c62c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469a31ea-f0, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469a31ea-f0, col_values=(('qos', UUID('217f991b-0cc9-40eb-9bc8-4cd9f1d08a22')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469a31ea-f0, col_values=(('external_ids', {'iface-id': '469a31ea-f0e3-4ce1-9a5a-54bf4261b413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:13:46', 'vm-uuid': '0dd89aef-3e72-4e04-b0bb-63be3d003138'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:12 user nova-compute[75215]: INFO os_vif [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0')
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No VIF found with MAC fa:16:3e:fb:13:46, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:30:13 user nova-compute[75215]: WARNING nova.compute.manager [req-6bba5ec5-9cc8-40f1-845a-f5a1a7e219ab req-a4c4ff52-0407-41c8-aaa1-6145669dc642 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state building and task_state spawning.
Nov 29 15:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 15:30:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance spawned successfully.
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 15:30:15 user nova-compute[75215]: INFO nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:30:15 user nova-compute[75215]: INFO nova.compute.manager [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Took 6.20 seconds to build instance.
Nov 29 15:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7982d9c6-2d29-445f-903f-8d25a12296b7 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.300s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:30:15 user nova-compute[75215]: WARNING nova.compute.manager [req-893407e3-8b38-4065-9c61-dbf411c74129 req-6c968e22-d234-4cf1-ab31-36a469bc1705 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state active and task_state None.
Nov 29 15:30:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:30:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:30:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:30:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:30:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:30:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=24.74561309814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:30:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:30:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:30:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:30:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:30:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:30:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Triggering sync for uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 15:31:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:31:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:31:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:31:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:31:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:31:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:31:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=24.743576049804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:31:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:31:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:31:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:31:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:32:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:03 user nova-compute[75215]: INFO nova.compute.manager [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Attaching volume 7c334952-5a2b-43b1-88ea-9460e74d6a1f to /dev/vdb
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.utils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b995822-d088-43b1-a45c-17260f0ab4ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:74ef49286c56\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d36c9b-1a25-43f3-bd51-5a12823d1af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a877ef5-b254-4311-bd69-765bee31f135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6cf31d-5deb-41e0-994b-29e02b5ae687]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 15:32:03 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 15:32:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a04146-246f-4932-b399-8cabe5c05e1b]: (4, '') {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG os_brick.utils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:74ef49286c56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:32:03 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating existing volume attachment record: 9ce26b42-55a6-46ca-9e7e-8a9a787dc95c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 15:32:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIUJFpvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:32:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:32:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:32:12 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d413856-eea4-4519-81f4-1a95e0c2e9bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 15:32:12 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4bb3e-8a95-4f3d-b2bf-388254b10597]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f] added\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f] added
Nov 29 15:32:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec194d-90e0-46f9-8244-077b7b62706e]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3672eee-7d37-4cd3-bf42-5e1d244ee510]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIUJFpvK {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIUJFpvK" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[788da4ac-a55b-41fc-af70-e8fbb37f27cb]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIUJFpvK'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5b0d7-6e59-4709-9996-2d0d947a90df]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[238d70e6-0308-4a6f-b7cb-f9f724bf0bf5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:32:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 15:32:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:32:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 15:32:13 user nova-compute[75215]: 
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --login {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31118d80-badd-4b1a-b1df-18f9f478a418]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260]
Nov 29 15:32:13 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260] successful.
Nov 29 15:32:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8954945-c04d-4b4f-b9db-802d8ea4a9e5]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b8a60-8c84-43ef-8fce-fadf5cf00ea3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)
Nov 29 15:32:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)
Nov 29 15:32:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c763e9-a16e-4c07-80d9-5603c07f9b55]: (4, ('- - 0', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:32:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIUJFpvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26333633432383835', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333633432383835', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 15:32:14 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:32:14 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:32:14 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:32:14 user nova-compute[75215]:   <serial>7c334952-5a2b-43b1-88ea-9460e74d6a1f</serial>
Nov 29 15:32:14 user nova-compute[75215]: </disk>
Nov 29 15:32:14 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 15:32:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] No VIF found with MAC fa:16:3e:fb:13:46, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 15:32:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7533fc3d-c5c6-4671-b80c-10c2a2356af3 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.976s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing instance network info cache due to event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:32:17 user nova-compute[75215]: DEBUG nova.network.neutron [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:32:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated VIF entry in instance network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:32:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:32:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19d00d95-f798-4c21-9093-667e0d96a5e0 req-059d1b95-fe98-47f1-a366-2dc1e7a10ebe service nova] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:32:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing instance network info cache due to event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated VIF entry in instance network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1211b295-7779-4b73-b2a4-ae40aebe5f22 req-45e01a22-b35c-42ef-b282-33d1b56c4319 service nova] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:20 user nova-compute[75215]: INFO nova.compute.manager [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Rebooting instance
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:32:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 15:32:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:32:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:32:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:32:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:32:23 user nova-compute[75215]: WARNING nova.compute.manager [req-cf7fb4e1-81d1-40a8-97c6-5aeebfb818ec req-67ea7986-3abe-4b10-92e4-5e321453c609 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state active and task_state reboot_started.
Nov 29 15:32:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance shutdown successfully.
Nov 29 15:32:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:32:25 user nova-compute[75215]: WARNING nova.compute.manager [req-c22646da-c656-402a-8015-d33c02b66417 req-ac5a2a22-d204-4e42-9ea7-549510d01307 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state active and task_state reboot_started.
Nov 29 15:32:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance running successfully.
Nov 29 15:32:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance soft rebooted successfully.
Nov 29 15:32:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:32:27 user nova-compute[75215]: WARNING nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state active and task_state reboot_started.
Nov 29 15:32:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:32:27 user nova-compute[75215]: WARNING nova.compute.manager [req-e5a5898a-bd11-4e18-bdd9-6b650ad0d8d7 req-1a0a6c7a-7eb2-436d-94f5-d8bdfa3766f7 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state active and task_state reboot_started.
Nov 29 15:32:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb1092d7-01cf-4d8b-9231-80ab7ed1ab0e tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.148s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:32:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:32:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:32:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:32:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.741729736328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:32:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:32:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:32:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:33:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:33:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 15:33:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:33:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9086MB free_disk=24.74100112915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:33:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:33:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:33:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:34:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing instance network info cache due to event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:34:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated VIF entry in instance network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7897b034-96be-482c-ab0e-68667c509f09 req-79fd9902-23c9-418d-9379-598078c4d48b service nova] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:34:13 user nova-compute[75215]: INFO nova.compute.manager [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Detaching volume 7c334952-5a2b-43b1-88ea-9460e74d6a1f
Nov 29 15:34:13 user nova-compute[75215]: INFO nova.virt.block_device [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Attempting to driver detach volume 7c334952-5a2b-43b1-88ea-9460e74d6a1f from mountpoint /dev/vdb
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Attempting to detach device vdb from instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:34:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:34:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:34:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:34:13 user nova-compute[75215]:   <serial>7c334952-5a2b-43b1-88ea-9460e74d6a1f</serial>
Nov 29 15:34:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:34:13 user nova-compute[75215]: </disk>
Nov 29 15:34:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:34:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully detached device vdb from instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 from the persistent domain config.
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 15:34:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 15:34:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 15:34:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 29 15:34:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 29 15:34:13 user nova-compute[75215]:   <serial>7c334952-5a2b-43b1-88ea-9460e74d6a1f</serial>
Nov 29 15:34:13 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 15:34:13 user nova-compute[75215]: </disk>
Nov 29 15:34:13 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing instance network info cache due to event network-changed-469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Refreshing network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated VIF entry in instance network info cache for port 469a31ea-f0e3-4ce1-9a5a-54bf4261b413. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-dbf7e65b-f5fd-4ddc-97c7-0cc1a3b92fae req-260fa322-482d-4096-8dcb-6cd0ea97913a service nova] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:34:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquired lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lazy-loading 'info_cache' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [{"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Releasing lock "refresh_cache-0dd89aef-3e72-4e04-b0bb-63be3d003138" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:34:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 is timed out.
Nov 29 15:34:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully detached device vdb from instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 from the live domain config.
Nov 29 15:34:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4cac4d6560>, {'target_iqn': 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIUJFpvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 15:34:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf5514-867a-44ab-8c6f-bdb3410185b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 15:34:34 user nova-compute[75215]: No targets found.
Nov 29 15:34:34 user nova-compute[75215]: iSNS:
Nov 29 15:34:34 user nova-compute[75215]: No targets found.
Nov 29 15:34:34 user nova-compute[75215]: STATIC:
Nov 29 15:34:34 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f
Nov 29 15:34:34 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 29 15:34:34 user nova-compute[75215]:                 Iface Name: default
Nov 29 15:34:34 user nova-compute[75215]: FIRMWARE:
Nov 29 15:34:34 user nova-compute[75215]: No targets found.
Nov 29 15:34:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 15:34:34 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 15:34:34 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc126c-8bc4-434a-85f5-ed2f68cffad2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9ddf8-a574-402d-801c-b3812e7395ae]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)
Nov 29 15:34:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f (non-flash)
Nov 29 15:34:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c885baf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ba6bc-17c2-4868-b667-aae090690260]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[080ef065-16b1-49bf-ad61-ca7060ec0946]: (4, ('ok\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f0ad1-6a5a-4011-92ab-d59f692602a4]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d12e0c-23ad-458e-b145-0ba2717f1c4e]: (4, ('1', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9036542-1476-490c-8df4-6c3909a86628]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --logout {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6694f6-ca71-4bc8-8b7a-ddc5b7d8aaaa]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260]
Nov 29 15:34:34 user nova-compute[75215]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f, portal: 172.16.0.220,3260] successful.
Nov 29 15:34:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op delete {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c334952-5a2b-43b1-88ea-9460e74d6a1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85827) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7f8cb0-4436-4b4b-aeaa-74f90f411c41]: (4, ('', '')) {{(pid=85827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] <== disconnect_volume: return (296ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 15:34:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 15:34:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'flavor' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:34:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fdcfdcb6-1d10-4281-bc73-b720df05e146 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:34:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 15:34:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 15:34:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:34:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=24.740211486816406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Instance 0dd89aef-3e72-4e04-b0bb-63be3d003138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:34:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:34:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:34:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:07 user nova-compute[75215]: INFO nova.compute.manager [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Terminating instance
Nov 29 15:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7c37e4c3-f938-44ef-aab5-bd75f034bb5b req-8be2e117-3cc8-4766-9c18-f3ec3c116361 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-unplugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 15:35:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Instance destroyed successfully.
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lazy-loading 'resources' on Instance uuid 0dd89aef-3e72-4e04-b0bb-63be3d003138 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1313315679',display_name='tempest-TestMinimumBasicScenario-server-1313315679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1313315679',id=52,image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtbc9tu5BKq9jXDeOaGc0BlhxQrIkAYWAgVJqWCqlhxdk5VcRYUiSn1O9Dx2JfhptcarY4cTW6b3hKtuC6t/JEyixGuPyrf7Ab5xkt6ZMH3uBWjWDdAVJDy3V+e3BmWQ==',key_name='tempest-TestMinimumBasicScenario-616111826',keypairs=<?>,launch_index=0,launched_at=2023-11-29T15:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab09c1fec95d4633b23da4822d4b85db',ramdisk_id='',reservation_id='r-c7jj4978',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ab691a3-3d62-45e5-ad09-6cf148c1b243',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1672366294',owner_user_name='tempest-TestMinimumBasicScenario-1672366294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T15:32:28Z,user_data=None,user_id='461c47805db04f9ba7ad4a3898dacc96',uuid=0dd89aef-3e72-4e04-b0bb-63be3d003138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converting VIF {"id": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "address": "fa:16:3e:fb:13:46", "network": {"id": "72fe610a-eafc-44c1-af52-62c8d32fc2c4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-695281231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab09c1fec95d4633b23da4822d4b85db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469a31ea-f0", "ovs_interfaceid": "469a31ea-f0e3-4ce1-9a5a-54bf4261b413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG os_vif [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469a31ea-f0, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=217f991b-0cc9-40eb-9bc8-4cd9f1d08a22) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:08 user nova-compute[75215]: INFO os_vif [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:46,bridge_name='br-int',has_traffic_filtering=True,id=469a31ea-f0e3-4ce1-9a5a-54bf4261b413,network=Network(72fe610a-eafc-44c1-af52-62c8d32fc2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469a31ea-f0')
Nov 29 15:35:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Deleting instance files /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138_del
Nov 29 15:35:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Deletion of /opt/stack/data/nova/instances/0dd89aef-3e72-4e04-b0bb-63be3d003138_del complete
Nov 29 15:35:08 user nova-compute[75215]: INFO nova.compute.manager [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 15:35:08 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 15:35:08 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Took 0.49 seconds to deallocate network for instance.
Nov 29 15:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:35:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:09 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Deleted allocations for instance 0dd89aef-3e72-4e04-b0bb-63be3d003138
Nov 29 15:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b74e7e4e-125a-4859-b2a8-744c65246461 tempest-TestMinimumBasicScenario-1672366294 tempest-TestMinimumBasicScenario-1672366294-project-member] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] Acquiring lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] Lock "0dd89aef-3e72-4e04-b0bb-63be3d003138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] No waiting events found dispatching network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 15:35:10 user nova-compute[75215]: WARNING nova.compute.manager [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received unexpected event network-vif-plugged-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 for instance with vm_state deleted and task_state None.
Nov 29 15:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-2327a464-8ce2-47d2-9f68-993b8d07c3e2 req-c34c6272-4fa8-4756-b2da-fd328b897b92 service nova] [instance: 0dd89aef-3e72-4e04-b0bb-63be3d003138] Received event network-vif-deleted-469a31ea-f0e3-4ce1-9a5a-54bf4261b413 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 15:35:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 15:35:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 15:35:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 15:35:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 15:35:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 15:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 15:35:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:35:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 15:35:42 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Hypervisor/Node resource view: name=user free_ram=9209MB free_disk=24.767597198486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 15:35:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing inventories for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating ProviderTree inventory for provider 2212761d-64cd-4bb5-94ac-48b883e4044b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Updating inventory in ProviderTree for provider 2212761d-64cd-4bb5-94ac-48b883e4044b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing aggregate associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Refreshing trait associations for resource provider 2212761d-64cd-4bb5-94ac-48b883e4044b, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed in ProviderTree for provider: 2212761d-64cd-4bb5-94ac-48b883e4044b {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Inventory has not changed for provider 2212761d-64cd-4bb5-94ac-48b883e4044b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 15:35:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 15:35:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 15:35:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 15:35:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:35:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 15:35:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-93df7603-5e6b-4d09-846a-eb0b1026a238 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 15:36:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 15:36:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}